-- Logs begin at Thu 2022-06-23 11:12:42 UTC, end at Thu 2022-06-23 12:12:37 UTC. -- Jun 23 11:41:56.632545 dv-cinder-826608-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 11:41:56.644456 dv-cinder-826608-3-smb devstack@keystone.service[80154]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:41:56 2022] *** Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: nodename: dv-cinder-826608-3-smb Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: machine: x86_64 Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: clock source: unix Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: pcre jit disabled Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: detected number of CPU cores: 4 Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: current working directory: / Jun 23 11:41:56.646483 dv-cinder-826608-3-smb devstack@keystone.service[80154]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: your processes number limit is 47680 Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: your memory page size is 4096 bytes Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: detected max file descriptor number: 2048 Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: lock engine: pthread robust mutexes Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: thunder lock: enabled Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 11:41:56.646996 dv-cinder-826608-3-smb devstack@keystone.service[80154]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:41:56.695241 dv-cinder-826608-3-smb devstack@keystone.service[80154]: Python main interpreter initialized at 0x5632b12fd9c0 Jun 23 11:41:56.695241 dv-cinder-826608-3-smb devstack@keystone.service[80154]: python threads support enabled Jun 23 11:41:56.695241 dv-cinder-826608-3-smb devstack@keystone.service[80154]: your server socket listen backlog is limited to 100 connections Jun 23 11:41:56.695241 dv-cinder-826608-3-smb devstack@keystone.service[80154]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:41:56.695594 dv-cinder-826608-3-smb devstack@keystone.service[80154]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:41:56.695665 dv-cinder-826608-3-smb devstack@keystone.service[80154]: *** Operational MODE: preforking *** Jun 23 11:41:56.695933 dv-cinder-826608-3-smb devstack@keystone.service[80154]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:41:56.695933 dv-cinder-826608-3-smb devstack@keystone.service[80154]: spawned uWSGI master process (pid: 80154) Jun 23 11:41:56.696153 dv-cinder-826608-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 11:41:56.697224 dv-cinder-826608-3-smb devstack@keystone.service[80154]: spawned uWSGI worker 1 (pid: 80158, cores: 1) Jun 23 11:41:56.697224 dv-cinder-826608-3-smb devstack@keystone.service[80154]: spawned uWSGI worker 2 (pid: 80159, cores: 1) Jun 23 11:41:56.697224 dv-cinder-826608-3-smb devstack@keystone.service[80154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:42:02.082047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:42:02.082047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: from cryptography.utils import int_from_bytes Jun 23 11:42:02.082872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:42:02.082872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes Jun 23 11:42:02.083285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:42:02.083285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: from cryptography.utils import int_from_bytes Jun 23 11:42:02.083396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:42:02.083396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes Jun 23 11:42:02.130915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:42:02.131105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:42:02.131207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:42:02.131289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:42:02.131366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] command line args: [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:42:02.131432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] command line args: [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:42:02.131495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:42:02.131647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:42:02.131733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ================================================================================ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:42:02.131798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ================================================================================ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:42:02.131924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] admin_token = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config_dir = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] config_dir = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config_source = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] config_source = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] debug = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] debug = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.132877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.133166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.133261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.133321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.133377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.133441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.134764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.134867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.134936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.134995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.134995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_config_append = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_config_append = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_dir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_dir = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.135993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.136998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.137964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.138132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.138294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.138382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.138466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.138891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] publish_errors = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] publish_errors = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139670 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.139967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] standard_threads = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] standard_threads = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.140941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_journal = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] use_journal = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_json = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] use_json = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_stderr = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] use_stderr = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_syslog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] use_syslog = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.141930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:42:02.142075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.142862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.143969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.144907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.145955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146236 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.146893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.147966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.148986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.149984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.150902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.151902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.152950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.153917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.154939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.155963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.156904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.157912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.158936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.159961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.160985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.161918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.162908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.163975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.164950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.165933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.external = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.external = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.166961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.password = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.password = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] auth.token = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.167920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.token = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.168954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.169904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.170955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.171997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.172947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.173993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.174956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.175886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.176989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.177965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.178996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.179925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.180995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.181948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.182899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183490 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.183964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.184894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.185935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.186979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.187919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.188954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.189952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.190984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.191910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.192949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.193935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.194983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.195918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.196032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.196144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.196258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.196372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.196726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.196891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.197916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.198957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.199947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] role.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] role.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.200992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.201936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.202993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.203916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.204963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.205907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.206961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.207998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.208928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.209992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.210913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.211963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.212961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.213948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.214917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.215979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.216901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:42:02.217016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:42:02.217132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:42:02.245781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.245961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.246080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.246161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.246224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.246386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.254778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.254884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.282921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.283105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.283105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.283392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.429139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.429333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.477144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.477387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.478950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.479183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.541963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.542921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.543000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.543119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.543196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.568992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.569118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.569257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.569338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.569417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.569661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.580552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.580768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.593334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.593588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.593780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.593916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.594961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.595096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.595224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:42:02.613505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.613728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:42:02.613891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.614061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.614154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:42:02.614316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:42:02.614812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.614950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:42:02.615148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.615926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.626322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.626598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.626861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.627055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.627150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.627286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.627436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.627734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.635573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.636090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.638863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.639134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.639391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.639537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.639620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.639686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.639936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.640968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.641094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.641276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.641403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.641539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.641874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.642003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.642003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.667904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.668520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.669496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.669795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.670149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.670425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.675016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.675403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.675647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.675748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.676060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.676391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.683016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.683270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.683629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.683906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.687710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.687993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.688272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.688418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.688503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.688637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.688795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.688922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.689996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.690256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.708138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.708473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.709092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.709362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.713130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.714039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.716734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.717126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.717627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.718038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.722178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.723030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.725792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.726630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.729497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.729829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.730932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.731160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.731429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.731703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.750355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.750629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.750863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.751136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.751235 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.751457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.751723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.751992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.759092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.760175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.760873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.761141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.761895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.762178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.764348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.764587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.764893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.765197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.765421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.765562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.765716 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.766038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.766336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.766639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.778750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.779026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.779313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.779590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.779874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.780151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.780441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.780720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.781284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.781571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.781877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.782445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.782767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.783025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.800983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.802650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.804278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.806023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.807643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.809353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.809502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.810986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.811114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.811259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.811498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.812725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.813001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.813268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.818791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.820385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.820530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.822219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.823643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.823939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.824323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.824608 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.825411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.825738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.826126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.826382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.833635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.833918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.834202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.835425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.835708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.835985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.842079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.842355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.842626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.842889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.843154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.843533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.843816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.843940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:42:02.844074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.844966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.845118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.845244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.845351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.845558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.845711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.845811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.846099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.846361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.846627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.846891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.847156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.847430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:42:02.884085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632b12fd9c0 pid: 80158 (default app) Jun 23 11:42:02.885426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632b12fd9c0 pid: 80159 (default app) Jun 23 11:42:02.887655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15e5c1-b16c-458e-953f-ca4bb7533a44 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:02.887947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15e5c1-b16c-458e-953f-ca4bb7533a44 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:02.888233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15e5c1-b16c-458e-953f-ca4bb7533a44 None None] PATH_INFO: `/v3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:02.892455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Thu Jun 23 11:42:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:10.691497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:10.692116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:10.692116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:10.696503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:10.703323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:10.703837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:10.703940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:10.777048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: INFO dbcounter [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] Registered counter for database keystone Jun 23 11:42:10.802437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG oslo_db.sqlalchemy.engines [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:42:10.815255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writer thread running {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:42:11.020222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80158) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 11:42:11.020643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80158) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 11:42:11.079993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:11.082705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:11.226870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 11:42:11.387068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:11.465492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: INFO dbcounter [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] Registered counter for database keystone Jun 23 11:42:11.486403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG oslo_db.sqlalchemy.engines [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:42:11.497077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writer thread running {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:42:11.624538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b122bdd-6e2d-446a-ad25-d8d967067718 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:11.629167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:11.629864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:11.630149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:11.630426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:11.639046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:11.690053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 11:42:11.690394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a071bca-0f75-4983-8de4-0193d2d0f4e6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:11.701258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Jun 23 11:42:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:42:11.708007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:11.724382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31508662-767e-44c1-8f11-6d2b701b12d7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:11.737339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:11.738561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:11.738852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:11.739135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] PATH_INFO: `/v3/projects/0d05c319491241dd84abdf976390ca06` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:11.743906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d05c319491241dd84abdf976390ca06)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:11.795228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 11:42:11.795574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9962398-3fa3-44bd-a35e-610b74ef8a16 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:11.800420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Thu Jun 23 11:42:11 2022] GET /identity/v3/projects/0d05c319491241dd84abdf976390ca06 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:13.837591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f6831-bceb-4b19-bba2-2e41af1ae3e0 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.838185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f6831-bceb-4b19-bba2-2e41af1ae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.838185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f6831-bceb-4b19-bba2-2e41af1ae3e0 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.842415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:13.849170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.849777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.849939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.872153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:13.873679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:13.882570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 11:42:13.906276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f6831-bceb-4b19-bba2-2e41af1ae3e0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.924624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f6831-bceb-4b19-bba2-2e41af1ae3e0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.930423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fb30d-1500-4a02-a1de-359b0941fbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.931734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb30d-1500-4a02-a1de-359b0941fbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.931734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb30d-1500-4a02-a1de-359b0941fbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.931927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb30d-1500-4a02-a1de-359b0941fbfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.941678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fb30d-1500-4a02-a1de-359b0941fbfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.943508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fb30d-1500-4a02-a1de-359b0941fbfa admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.953664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Jun 23 11:42:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:42:13.962522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.976664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946573d-bbae-48a4-ae96-eb97e031c860 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.983052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b8cf1-666f-49e8-80e1-1f5261ac3765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.983945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b8cf1-666f-49e8-80e1-1f5261ac3765 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.984229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b8cf1-666f-49e8-80e1-1f5261ac3765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.984509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b8cf1-666f-49e8-80e1-1f5261ac3765 admin admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.986148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b8cf1-666f-49e8-80e1-1f5261ac3765 admin admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.988030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b8cf1-666f-49e8-80e1-1f5261ac3765 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.990048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Thu Jun 23 11:42:13 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:16.122159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035b12-7511-4b7e-bcf5-d224bb7a8381 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.122688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035b12-7511-4b7e-bcf5-d224bb7a8381 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.122688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035b12-7511-4b7e-bcf5-d224bb7a8381 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.124077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:16.129578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.130033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.130209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.150955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:16.152175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:16.231641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014b5c-b9a9-4f05-8bbe-dd9f5f328f6a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.231930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014b5c-b9a9-4f05-8bbe-dd9f5f328f6a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.232388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014b5c-b9a9-4f05-8bbe-dd9f5f328f6a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.233881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:16.239875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.240293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.240650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.247301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:16.272008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.287194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG passlib.handlers.bcrypt [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80159) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 11:42:16.287633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG passlib.handlers.bcrypt [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80159) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 11:42:16.299496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.334294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:16.335958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:16.402777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4e482-2a14-4760-bb43-36a7c296c781 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.438328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.438996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.439311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.439597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.445741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:16.470025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.520786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:16.523568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:16.550346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.574471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745c2d9-4336-49a9-a8c8-713482810340 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.576796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.613391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.614839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.615137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.615421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.632250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:16.635253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:16.641015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:16.652414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:16.653572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:16.654577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:16.655194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:16.660585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.746665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf7542-3398-40cb-baf8-0066c114f8e3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.764284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5e4bb-8ed4-4da3-a701-0c0e74ad1d8a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.770282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.783838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.784677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.784960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.785222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.796110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:16.797607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:16.800415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.801110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.801395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.801712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.802490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:16.802802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:16.804268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:16.817705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 9/16] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:42:16.818934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:16.819807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:16.820758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:42:16.820758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:42:16.820758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:42:16.820758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:16.820758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:16.824089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.825713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.869668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.937382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35889feb-e03c-437a-8f9b-dc6520ce25c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.950995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d410-ec33-4060-8cde-0e5184d6934b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.970649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.971335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.971621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.971898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.972633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:16.972946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:16.974372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:16.991027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.991989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.992109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:16.992355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.992563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.994258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:16.995777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:16.997487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:17.003540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:17.042030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:17.115968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871d07b-ec9d-44a5-b5a7-61337a2a8be3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:17.154227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a623ba-29f9-46ff-ade8-1883d8a57089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:17.155040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a623ba-29f9-46ff-ade8-1883d8a57089 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:17.155328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a623ba-29f9-46ff-ade8-1883d8a57089 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:17.155611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a623ba-29f9-46ff-ade8-1883d8a57089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:17.157786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a623ba-29f9-46ff-ade8-1883d8a57089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:17.158588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a623ba-29f9-46ff-ade8-1883d8a57089 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:17.160232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:17.166285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:17.272222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:17.280459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5603ee-2574-4167-9402-722cfda6ae4e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:17.323069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:17.323747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:17.324033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:17.324314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:17.325288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.domain.id=default, user.id=81d8701e76e24867a0ae6f975b85ab36) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:17.325652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:17.327110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17794dd-ff85-4d05-b3ed-aade4f060175 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:17.336583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Jun 23 11:42:17 2022] GET /identity/v3/role_assignments?user.id=81d8701e76e24867a0ae6f975b85ab36&scope.domain.id=default&role.id=2702c53281284456a65007036b36070c => generated 233 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:19.179527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd95a4-b6cf-4b8c-af53-12f131ef36bc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:19.180751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd95a4-b6cf-4b8c-af53-12f131ef36bc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:19.181234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd95a4-b6cf-4b8c-af53-12f131ef36bc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:19.182854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:19.188467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:19.189314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:19.189845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:19.213549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:19.215118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:19.308214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:19.346524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd95a4-b6cf-4b8c-af53-12f131ef36bc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:19.479556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd95a4-b6cf-4b8c-af53-12f131ef36bc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:19.481751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:19.528734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:19.529557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:19.529869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:19.530148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:19.546452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:19.547993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:42:19.580867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:19.581748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:19.582511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:42:19.582511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:42:19.582511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:42:19.582511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:19.582511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 12/24] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:19.588728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:19.727142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:19.743632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd341c-bef7-414a-9ca1-b7b6f3a96670 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:19.795219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:19.795908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:19.796193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:19.796465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:19.797208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:19.797506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:19.798955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243b22-d0d7-4649-bafd-03b24ddb02ba None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:19.827881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 13/25] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:19.833483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:20.024380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2924a-0bda-4024-851d-379e49c353de None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:20.071280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18d67-a363-4c2a-9d03-7ee87d84567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:20.071965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18d67-a363-4c2a-9d03-7ee87d84567a None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.072255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18d67-a363-4c2a-9d03-7ee87d84567a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.072534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18d67-a363-4c2a-9d03-7ee87d84567a None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.073263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18d67-a363-4c2a-9d03-7ee87d84567a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:20.074864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18d67-a363-4c2a-9d03-7ee87d84567a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:20.222264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cb546-8384-40cf-8d5f-51a3c04dca69 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.223250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cb546-8384-40cf-8d5f-51a3c04dca69 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.223715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cb546-8384-40cf-8d5f-51a3c04dca69 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.229359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:20.231257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd47d-f135-4796-9d70-dd467cfdd2a1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.231741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd47d-f135-4796-9d70-dd467cfdd2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.232204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd47d-f135-4796-9d70-dd467cfdd2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.239189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 13/27] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:42:19 2022] POST /identity/v3/projects => generated 301 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:20.270082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c13c6-ade1-417c-8eb2-04b69df1a4f7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.270730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c13c6-ade1-417c-8eb2-04b69df1a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.271233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c13c6-ade1-417c-8eb2-04b69df1a4f7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.272844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 14/28] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:20.283075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-121fd47d-f135-4796-9d70-dd467cfdd2a1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:20.284232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-121fd47d-f135-4796-9d70-dd467cfdd2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:20.300159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.300978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.314671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.334012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:20.342840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:20.344429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:20.420107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 15/29] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:20.422233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c47e-c3e0-4719-b673-e01780bf4e5f None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.422784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c47e-c3e0-4719-b673-e01780bf4e5f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.423555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c47e-c3e0-4719-b673-e01780bf4e5f None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.425358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:20.432929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.433482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.434012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.475509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:20.482699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:20.564130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 15/31] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:20.564130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:20.623301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 17/32] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:20.624464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:20.647931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:20.783672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229c4cc-2bb3-4134-9b91-1907ffbfbbff None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:20.799280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996e60-f4c3-4f6a-8702-0ea0524d8624 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:20.830976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:20.831663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.831881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.832140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.832898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:20.834469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:20.837302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc140a-c801-4f6a-90e4-6b7bcdf8ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:20.838214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc140a-c801-4f6a-90e4-6b7bcdf8ac34 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.838755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc140a-c801-4f6a-90e4-6b7bcdf8ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.838755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc140a-c801-4f6a-90e4-6b7bcdf8ac34 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.839433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:20.839534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc140a-c801-4f6a-90e4-6b7bcdf8ac34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:20.841079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc140a-c801-4f6a-90e4-6b7bcdf8ac34 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:20.854928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 16/33] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 23 11:42:20 2022] POST /identity/v3/roles => generated 225 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:20.855661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:20.988955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20728dc6-af61-453e-acd9-caad13daf6d7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:20.992887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 18/34] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 23 11:42:20 2022] POST /identity/v3/roles => generated 219 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:20.994520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56d19-5442-48cf-92bb-bfc139d42b38 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:20.994818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56d19-5442-48cf-92bb-bfc139d42b38 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:20.995106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56d19-5442-48cf-92bb-bfc139d42b38 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:20.996512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 19/35] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:21.011241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee803ed9-09f6-4104-bee9-80ba4baa1324 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.011551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee803ed9-09f6-4104-bee9-80ba4baa1324 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.011821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee803ed9-09f6-4104-bee9-80ba4baa1324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.030485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ee803ed9-09f6-4104-bee9-80ba4baa1324 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:21.032072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ee803ed9-09f6-4104-bee9-80ba4baa1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:21.037588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.038488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.038778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.039064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.053089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:21.062596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:21.063501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:21.064459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 17/36] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:21.072286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.127911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:21.135707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 20/37] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:21.137263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae452-a68f-4425-96dc-b5ae74bd1824 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.137569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae452-a68f-4425-96dc-b5ae74bd1824 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.137885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae452-a68f-4425-96dc-b5ae74bd1824 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.144346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 21/38] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:21.145943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.146427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.146716 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.164303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:21.169203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:21.170474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:21.209646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ea65-f29b-4a68-853a-c4590a8dab18 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.255193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.256444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.256964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.257475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.259028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:21.259335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 22/39] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:21.259698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.260176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.262246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.383754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23af0c-4044-4e75-ba9b-f0a35161a87a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.390152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 18/40] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:21.391041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.413803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:21.423549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.424243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.424534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.424822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.425593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.427192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.441510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 23/41] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 23 11:42:21 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:21.442436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.524577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9bf46-e7bf-4069-8260-cdc8b95480e7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.546534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:21.570386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376ce4b-e94f-437b-89de-43d08de589e5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.570826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.571956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.572369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.572622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.574026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.575609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.577733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 19/42] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:21.583373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.621773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.622697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.623156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.623286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.626191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.629118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.629375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 24/43] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:21 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:21.635140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.695880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:21.698716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557f7f7-8404-455c-be53-83a8abb0b2b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.734977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.735657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.735949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.736228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.736956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.738471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.743962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604a8c0-c930-494a-a369-1faa81ccb1c8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.765198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 20/44] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:42:21 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:42:21.780081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddef156-b9b4-43c6-9920-0e9b3052a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.780954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef156-b9b4-43c6-9920-0e9b3052a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.781249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef156-b9b4-43c6-9920-0e9b3052a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.781526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef156-b9b4-43c6-9920-0e9b3052a9d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.782885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddef156-b9b4-43c6-9920-0e9b3052a9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.784411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddef156-b9b4-43c6-9920-0e9b3052a9d5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.786421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 25/45] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:21.792639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:21.838383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:21.912026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ccdeb-d880-4278-8943-0aa6738bdf40 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:21.948715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c138b-6832-4b4d-8166-09dbd7a5ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:21.949647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c138b-6832-4b4d-8166-09dbd7a5ec0e None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:21.949941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c138b-6832-4b4d-8166-09dbd7a5ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:21.950220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c138b-6832-4b4d-8166-09dbd7a5ec0e None admin] PATH_INFO: `/v3/domains/default/users/81d8701e76e24867a0ae6f975b85ab36/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:21.952326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c138b-6832-4b4d-8166-09dbd7a5ec0e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=81d8701e76e24867a0ae6f975b85ab36, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:21.954011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c138b-6832-4b4d-8166-09dbd7a5ec0e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:21.971872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 21/46] 10.222.0.27 () {58 vars in 1361 bytes} [Thu Jun 23 11:42:21 2022] PUT /identity/v3/domains/default/users/81d8701e76e24867a0ae6f975b85ab36/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:23.834400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9211-95f3-4220-98c3-026946542fa2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:23.834943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9211-95f3-4220-98c3-026946542fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:23.834943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9211-95f3-4220-98c3-026946542fa2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:23.836366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 26/47] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:23.841881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055845c-6f6b-4a1f-8eec-e008e0dd2b40 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:23.842304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055845c-6f6b-4a1f-8eec-e008e0dd2b40 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:23.842421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055845c-6f6b-4a1f-8eec-e008e0dd2b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:23.860905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a055845c-6f6b-4a1f-8eec-e008e0dd2b40 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:23.862081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a055845c-6f6b-4a1f-8eec-e008e0dd2b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:23.933259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 22/48] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:23.956365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9211-95f3-4220-98c3-026946542fa2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:23.967951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc5dd-75c1-4166-9132-edc8b28a72e6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:23.968315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc5dd-75c1-4166-9132-edc8b28a72e6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:23.968610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc5dd-75c1-4166-9132-edc8b28a72e6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:23.970073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 23/49] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:23.975139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:23.975480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:23.975832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:23.997358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:23.998642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:24.023878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:24.074418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 24/50] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:24.074977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9211-95f3-4220-98c3-026946542fa2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.098300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:24.099060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:24.111002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:24.111747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:24.112045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:24.112330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:24.113530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:24.115402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:24.117150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:24.123247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:24.202538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf37f-7647-435e-be48-bb59fcddcf34 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.224508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609f69f-300c-4188-87c5-1938d0039076 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.239845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:24.240846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:24.241136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:24.241453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:24.255703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:24.264458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:24.265434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:24.266272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:24.267016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:24.267016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:24.267016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:24.267230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:24.268041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:24.269671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:24.271679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:24.292396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:24.305656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 28/53] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Jun 23 11:42:24 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:42:24.388263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35067f11-185a-4b9f-875c-8391779a403a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.425866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:24.426581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:24.426874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:24.427153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:24.427944 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:24.428260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:24.429730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:24.439598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 26/54] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:24.445404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:24.499493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:24.555814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f839d6-3707-451e-84f2-947d537c3a45 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.591897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:24.592787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:24.593077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:24.593368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:24.594619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:24.596136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:24.598038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:24 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:24.603794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:24.690951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:24.710496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f053b-ee10-4cbc-a570-82b31fb27931 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.746646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df395020-ccca-426e-97a0-e0a630dd23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:24.747438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395020-ccca-426e-97a0-e0a630dd23b3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:24.747740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395020-ccca-426e-97a0-e0a630dd23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:24.748023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395020-ccca-426e-97a0-e0a630dd23b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:24.749250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df395020-ccca-426e-97a0-e0a630dd23b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:24.750772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df395020-ccca-426e-97a0-e0a630dd23b3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:24.752426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:24.758452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:24.977713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf365f8-0e93-4e0f-9731-12ff6f068b3f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:24.991759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:25.014187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:25.014854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:25.015138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:25.015414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:25.016261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.domain.id=default, user.id=81d8701e76e24867a0ae6f975b85ab36) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:25.016572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:25.018074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b8a1-ab4b-48fb-96d0-63a3f8454b17 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:25.024589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 30/57] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Jun 23 11:42:24 2022] GET /identity/v3/role_assignments?user.id=81d8701e76e24867a0ae6f975b85ab36&scope.domain.id=default&role.id=2702c53281284456a65007036b36070c => generated 530 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:26.394208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9041-da65-417f-bd64-5dfae6b0fe13 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:26.394792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9041-da65-417f-bd64-5dfae6b0fe13 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:26.394792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9041-da65-417f-bd64-5dfae6b0fe13 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:26.396179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:26.403160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:26.403805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:26.404108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:26.425888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:26.427109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:26.509480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:26.534091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9041-da65-417f-bd64-5dfae6b0fe13 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:26.649848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9041-da65-417f-bd64-5dfae6b0fe13 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:26.686607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d16aba-d647-446b-b21d-20407fd6bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:26.687414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d16aba-d647-446b-b21d-20407fd6bc82 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:26.687704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d16aba-d647-446b-b21d-20407fd6bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:26.687987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d16aba-d647-446b-b21d-20407fd6bc82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:26.689205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d16aba-d647-446b-b21d-20407fd6bc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:26.690738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d16aba-d647-446b-b21d-20407fd6bc82 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:26.692365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:26.698535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:26.808313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54605e5-064d-407b-a57d-4c817ba05ab1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:26.816348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:26.847423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2273d4-0962-4b44-baf8-22563341a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:26.848100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2273d4-0962-4b44-baf8-22563341a89e None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:26.848379 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2273d4-0962-4b44-baf8-22563341a89e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:26.848658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2273d4-0962-4b44-baf8-22563341a89e None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:26.849373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2273d4-0962-4b44-baf8-22563341a89e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:26.850891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2273d4-0962-4b44-baf8-22563341a89e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:26.882411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:26 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:30.165538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8076dbd-8d1f-4261-ab2c-193ed2ef9fe9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.166427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8076dbd-8d1f-4261-ab2c-193ed2ef9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.166917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8076dbd-8d1f-4261-ab2c-193ed2ef9fe9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.168518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:30.174099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafb13c-5d57-40bd-8ab9-24755de0fef1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.174917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafb13c-5d57-40bd-8ab9-24755de0fef1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.175344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafb13c-5d57-40bd-8ab9-24755de0fef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.198036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9aafb13c-5d57-40bd-8ab9-24755de0fef1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:30.199807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9aafb13c-5d57-40bd-8ab9-24755de0fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:30.203184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb750-c6d8-4688-8dd4-4352dfcf0e25 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.203758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb750-c6d8-4688-8dd4-4352dfcf0e25 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.204235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eb750-c6d8-4688-8dd4-4352dfcf0e25 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.205859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:30.211415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.211991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.212486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.230395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:30.231932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:30.261997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:30.325037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 33/64] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:30.340746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94188-4304-41ad-9124-1f4ee4fc12e2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.341054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94188-4304-41ad-9124-1f4ee4fc12e2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.341327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94188-4304-41ad-9124-1f4ee4fc12e2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.342749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 34/66] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:30.342858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 32/66] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:30.351057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.351356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.351645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.364313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.376979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:30.378220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:30.457821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:30.458766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.471132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d1d0c-0cea-427f-a5fd-6ddd922846b3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:30.500223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:30.514152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:30.515248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.515681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.516103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.528536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:30.536497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:30.537617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:30.538546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:30.540742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 33/68] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:30.541768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.551667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:30.578686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c74a2c-ef6e-44a7-9585-abcd758fa0b9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:30.617221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:30.618407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.618906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.619365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.631196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:30.639204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:30.640069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:30.640876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 36/69] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:30.641547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.649458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbea65-8d03-4917-9ecc-a4f920435a30 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:30.689693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d482fa-a596-467e-a14a-8c0763d37ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:30.690583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d482fa-a596-467e-a14a-8c0763d37ffe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.691201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d482fa-a596-467e-a14a-8c0763d37ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.691494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d482fa-a596-467e-a14a-8c0763d37ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.702708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d482fa-a596-467e-a14a-8c0763d37ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-95d482fa-a596-467e-a14a-8c0763d37ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:30.710941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:30.711878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:30.712627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 34/70] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:30.713950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810f66-4678-4684-bc9d-0af8b7761648 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.713950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810f66-4678-4684-bc9d-0af8b7761648 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.714115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810f66-4678-4684-bc9d-0af8b7761648 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.715616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 35/71] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:30.716167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810f66-4678-4684-bc9d-0af8b7761648 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.742003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:30.762004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f4fb7-d50e-460c-a7dd-eb0039508378 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:30.792211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:30.795924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:30.796600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.796880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.797158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.797937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:30.798240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:30.799815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:30.808565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 37/72] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:30.809396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.832738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810f66-4678-4684-bc9d-0af8b7761648 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:30.869620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:30.870408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.870696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.870988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.871774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:30.872090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:30.873548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346729b-ff51-4484-8733-add38bfec3a9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:30.885696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:30.885696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.885696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.885696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.902214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:30.903465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:30.918649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0421f-bf43-4cfa-8371-d32ad8c1e719 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:30.956557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:30.957251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.957542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.957865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.958634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:30.958951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:30.960337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023b028-7aa4-468b-a70f-dc777630e909 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:30.969315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 38/74] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:30.970425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078276b3-faf4-4cfa-b0e7-546058679394 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:30.970760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078276b3-faf4-4cfa-b0e7-546058679394 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:30.971018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078276b3-faf4-4cfa-b0e7-546058679394 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:30.972270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 39/75] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:30.972990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078276b3-faf4-4cfa-b0e7-546058679394 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.974325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:30.975180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:30.984849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.037190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.079674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e349b0-a761-4af6-a902-8a965e5baa2c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.084523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078276b3-faf4-4cfa-b0e7-546058679394 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.114416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1c120-65bf-4db7-87ba-b1c59bf64026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.115691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c120-65bf-4db7-87ba-b1c59bf64026 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.115990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c120-65bf-4db7-87ba-b1c59bf64026 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.116263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c120-65bf-4db7-87ba-b1c59bf64026 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.118988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.119876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.120600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.120600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.121715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.123189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.124887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:31.125682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.129966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c120-65bf-4db7-87ba-b1c59bf64026 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.131466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c120-65bf-4db7-87ba-b1c59bf64026 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.133203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 38/78] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:30 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:31.134427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.134719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.134997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.151437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:31.152645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:31.203534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.226849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 39/79] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:31.226849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.235981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c553a37-16aa-475c-b820-bdd1c55e1151 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.271914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.272805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.273093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.273377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.274670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.274878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.276160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.278585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:31.279370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.336352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69f502-006f-4fa9-87d9-5188e93d392b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.371058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.371874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.372161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.372441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.382924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:31.384752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba91d5-437c-4002-93c9-37a1fd247fcd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:31.390717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:31.391568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:31.392402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 40/81] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:31.393941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.422279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.422949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.423233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.423521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.438035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.499632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.500472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f9c8d-5fab-4441-8c56-53236aa6734e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.501096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.507716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.536369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.537028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.537312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.537621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.605548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 42/82] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:31.606090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.611772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.613292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.650866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.708059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7a3f8-581b-4963-bec8-03034dee1a2c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.712360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 41/83] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:31.713211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.721417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.745143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.746002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.746311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.746567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.747810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.749302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.751046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 43/84] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:31.751765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.816314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9de4e-7626-4a32-8120-642dd26fd630 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.849647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c59e9-9f06-4ede-8d40-a89a2559e785 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:31.851901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.852575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.852871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.853157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.860825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:31.886739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:31.887427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:31.887711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:31.887997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:31.888769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:31.889084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.890534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.898767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 44/85] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:31.899622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:31.924498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:31.926049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:31.934739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.002446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33c132-4e04-454c-ab07-fdc7a86d6541 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.027368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:32.028514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.041622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.043004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.043289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.043579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.044889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.046374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.048148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 45/87] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:31 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.048910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.093421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.138648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f35eb-45d2-4ad0-b58a-3df9869f355b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.150104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.155335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8434b-5618-4ee3-9874-3e83ef9f208e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.180335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.181238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.181575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.181888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.183207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.184696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.186570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 43/88] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.191397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.197067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.197803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.198150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.199100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.200691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.202230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.225076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 46/89] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:32 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:32.235309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.309629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1225f8-2633-4aa4-9865-434728ab0734 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.342972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.351593 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.352167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd33fa4-2eb3-4262-8226-a423b42f99e5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.352979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.353440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.353892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.355468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.357158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.359415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 44/90] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.360370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.399189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.400086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.400378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.400661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.402191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.404763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.406190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 47/91] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.406988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.414726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.482147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40db09-6944-48ab-a789-a9e10fe5f6a2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.530638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.531564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.531996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.532431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.533444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=81d8701e76e24867a0ae6f975b85ab36) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:32.533822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.535301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.537879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5b912-6a22-4211-bbdb-422c4b397ee2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.545544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/role_assignments?user.id=81d8701e76e24867a0ae6f975b85ab36&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.546551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.584796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.585405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.585999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.586288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.587280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=576d89f5c5a645ba8a5a64a598301ef1) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:32.587700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.589799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.597553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 48/93] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/role_assignments?user.id=576d89f5c5a645ba8a5a64a598301ef1&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=74a02bd410af491aba0207712ba4d774 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.598320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:32.639462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.735674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c083951-35a5-46de-b194-cc912dcd1efc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.744472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:32.771598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270110c-1207-4f97-86c8-249cfda2cbfe None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:32.790679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.791428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.791719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.792099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.860361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:32.860983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:32.861278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:32.861571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:32.862525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] RBAC: Adding query filter params (role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=576d89f5c5a645ba8a5a64a598301ef1) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:32.862851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.864432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:32.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 49/94] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/role_assignments?user.id=576d89f5c5a645ba8a5a64a598301ef1&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=8206853c3da544e6afa9c839366fd552 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:32.913457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:32.915081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:33.066715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 46/95] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:33.072649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:33.264534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:33.274034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4235698-c245-45ad-a9b8-84b72a7981c9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:33.316799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c758b0-89dd-4ad8-b1a0-8f731d461c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:33.317743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c758b0-89dd-4ad8-b1a0-8f731d461c8c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:33.318152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c758b0-89dd-4ad8-b1a0-8f731d461c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:33.318452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c758b0-89dd-4ad8-b1a0-8f731d461c8c None admin] PATH_INFO: `/v3/projects/00553edd86414054a8aabe84f8afdeea` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:33.319730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c758b0-89dd-4ad8-b1a0-8f731d461c8c None admin] RBAC: Authorizing `identity:get_project(project_id=00553edd86414054a8aabe84f8afdeea)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:33.321331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c758b0-89dd-4ad8-b1a0-8f731d461c8c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:33.323529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 50/96] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:33 2022] GET /identity/v3/projects/00553edd86414054a8aabe84f8afdeea => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:33.329928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:33.344295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:33.488685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5529c0-240e-4f70-a4e8-6be209c7be11 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:33.531546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:33.532146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:33.532434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:33.532714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:33.533638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=00553edd86414054a8aabe84f8afdeea, user.id=576d89f5c5a645ba8a5a64a598301ef1) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:33.533963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:33.535491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b0aa1-2f06-42d9-a645-93263ac4c47f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:33.546186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 47/97] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:33 2022] GET /identity/v3/role_assignments?user.id=576d89f5c5a645ba8a5a64a598301ef1&scope.project.id=00553edd86414054a8aabe84f8afdeea&role.id=74a02bd410af491aba0207712ba4d774 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:35.048711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66b38-a453-4ab1-ba31-371fb53ba0e1 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.049801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66b38-a453-4ab1-ba31-371fb53ba0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.050326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66b38-a453-4ab1-ba31-371fb53ba0e1 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.051922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 51/98] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:35.057551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.058498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.058802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.086154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:35.087403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:35.184613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:35.190590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:35.230867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66b38-a453-4ab1-ba31-371fb53ba0e1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:35.374176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66b38-a453-4ab1-ba31-371fb53ba0e1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:35.416632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f0b5-e20b-4124-b3b9-19e859f1ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:35.417996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f0b5-e20b-4124-b3b9-19e859f1ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.418505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f0b5-e20b-4124-b3b9-19e859f1ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.418978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f0b5-e20b-4124-b3b9-19e859f1ebf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.420398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f0b5-e20b-4124-b3b9-19e859f1ebf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:35.422092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f0b5-e20b-4124-b3b9-19e859f1ebf9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:35.423977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 52/100] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:35.430714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:35.578152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a295ef-c824-41a4-83d4-0a90e27aa700 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.578498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a295ef-c824-41a4-83d4-0a90e27aa700 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.578732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a295ef-c824-41a4-83d4-0a90e27aa700 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.580144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 53/101] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:35.581367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950cb90-a7c8-4e74-8220-8cf5744b69c0 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.581546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950cb90-a7c8-4e74-8220-8cf5744b69c0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.581803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950cb90-a7c8-4e74-8220-8cf5744b69c0 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.583017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 54/102] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:35.588442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab02d80-40a5-4874-a5b3-2f0a0758f86a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.588768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab02d80-40a5-4874-a5b3-2f0a0758f86a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.589695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab02d80-40a5-4874-a5b3-2f0a0758f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.622877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524b96b-d905-4582-805b-f39cc943a6e4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:35.625476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bab02d80-40a5-4874-a5b3-2f0a0758f86a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:35.626678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bab02d80-40a5-4874-a5b3-2f0a0758f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:35.680101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:35.695471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a912072-4bfb-4b9a-a0a6-1c3202933446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:35.696177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a912072-4bfb-4b9a-a0a6-1c3202933446 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.696459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a912072-4bfb-4b9a-a0a6-1c3202933446 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.696738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a912072-4bfb-4b9a-a0a6-1c3202933446 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.697472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a912072-4bfb-4b9a-a0a6-1c3202933446 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:35.699745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a912072-4bfb-4b9a-a0a6-1c3202933446 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:35.758422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 49/103] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:42:35 2022] POST /identity/v3/projects => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:35.761515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.761855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.762143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.769386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 55/104] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:35.786194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:35.787661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:35.791854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b75d2-e7c6-4f0d-9578-e79cee7b94bf None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.793064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b75d2-e7c6-4f0d-9578-e79cee7b94bf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.793566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b75d2-e7c6-4f0d-9578-e79cee7b94bf None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.795283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 56/105] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:35.801087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:35.801640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:35.802195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:35.825141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:35.826665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:35.913111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:35.949865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 57/106] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:35.951011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:35.955561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 50/107] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:35.980954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.066428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.082505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dd0ca-ac92-4d4a-90b2-e89205646452 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.116541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c025de-3f55-4053-bb78-e9e42445b56b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.130542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.131957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.132459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.133383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.150385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:36.156674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.157661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.158046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.158418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:36.160688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:36.161733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:36.162505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:36.164946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 58/108] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:36.165924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.191327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:36.208867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:36.209807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:36.210644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 51/109] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:36.211270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.283880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d36c-64f7-4be1-bc6b-46722467ba9c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.289096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.331907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.333258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.333945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.334368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.349644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:36.350051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6976a-7161-48b8-af24-436bef98f984 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:36.359612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:36.360521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:36.361254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:36.365740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 59/110] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:36.366872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.386022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.395657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.396343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.396626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.396902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.397694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:36.398010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:36.399424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de7f56-2ed5-4d0a-b701-6274aa26f643 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:36.408699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 52/111] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:36.410269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b34a2-c90f-4ce3-ad56-b7d76e28982c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.410805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b34a2-c90f-4ce3-ad56-b7d76e28982c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.410805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b34a2-c90f-4ce3-ad56-b7d76e28982c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.416726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 53/112] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:36.418085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b34a2-c90f-4ce3-ad56-b7d76e28982c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.503245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04fa3c-499a-4221-9318-d5bd039db2fd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.539446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b34a2-c90f-4ce3-ad56-b7d76e28982c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.540678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.541357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.541676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.542148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.542983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:36.543303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:36.543576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.544718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:36.553946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 60/113] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:36.559066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.578702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.579392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.579682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.579971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.580740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:36.581244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:36.582502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad54e9-cf26-40df-b8f7-ed9d1dbcc6d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:36.596881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 54/114] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:36.596881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6cba-6c32-4352-a4a7-da5e4b81310f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.596881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6cba-6c32-4352-a4a7-da5e4b81310f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.596881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6cba-6c32-4352-a4a7-da5e4b81310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.618396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e4cd6cba-6c32-4352-a4a7-da5e4b81310f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:36.619745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e4cd6cba-6c32-4352-a4a7-da5e4b81310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:36.634992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.668061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92685da0-ca60-407a-9cad-7dafaa128ebd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.696449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 55/115] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:36.703739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.704634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.704917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.705199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.706461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:36.707557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f62a7-1b3e-4774-ac90-fb35ce0e263a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.707986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:36.708259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f62a7-1b3e-4774-ac90-fb35ce0e263a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.708747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f62a7-1b3e-4774-ac90-fb35ce0e263a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.709714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 61/116] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:36.710490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.714905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 56/117] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:36 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:36.715324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f62a7-1b3e-4774-ac90-fb35ce0e263a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.825903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.826101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0e52-2567-49d0-9dc2-3237a1f3c655 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.834063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f62a7-1b3e-4774-ac90-fb35ce0e263a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:36.868467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab57f5c-65db-4063-8185-d6c23d42bbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.869540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab57f5c-65db-4063-8185-d6c23d42bbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.869761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:36.869917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab57f5c-65db-4063-8185-d6c23d42bbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.870168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab57f5c-65db-4063-8185-d6c23d42bbe3 None admin] PATH_INFO: `/v3/users/498a952dd4bb43d28aec0c3ed9b95d83` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.870605 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.870893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.871172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.872418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:36.873942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:36.875633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 57/118] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:36.876415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:36.882624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:36.892366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab57f5c-65db-4063-8185-d6c23d42bbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=498a952dd4bb43d28aec0c3ed9b95d83)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:36.894737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab57f5c-65db-4063-8185-d6c23d42bbe3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:36.901863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 62/119] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/users/498a952dd4bb43d28aec0c3ed9b95d83 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:36.901863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:36.901863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:36.901863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:36.918679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:36.919932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:36.991585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013d979-4aa3-4192-9c69-7d7a66f741d5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.009624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 63/120] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:37.009624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.039243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.040134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.040437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.040707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.042655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.044163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.045970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 58/121] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:37.046747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.083385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.118903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b739420-1bbf-4411-865e-e1e59e544ce7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.147529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.157111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.157979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.158260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.158546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.164324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e488d-674a-4ce9-a9ce-6f7a72291a8e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.171688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:37.181262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:37.182195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:37.182996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 64/122] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:37.183707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.209902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.210778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.211060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.211338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.212667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.214173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.215918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 59/123] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:37.216765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.294528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f3678-e274-428f-b3a7-136dd240a188 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.326963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.330525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74395b-784a-499e-a5e1-047f02cde671 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.331667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.332330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.332640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.332928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.369558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.370653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.370991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.371335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.383034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:37.390914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:37.392011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:37.392959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:37.393690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 60/124] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:37.394146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.394258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.412454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.414022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.513619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d91a-d6be-4af7-a31c-f288f42fdaea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.527076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 65/125] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:37.527076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.556074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.557171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.557561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.557918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/576d89f5c5a645ba8a5a64a598301ef1/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.560094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e456a52276f4fc6af10bdd5f459c921, user_id=576d89f5c5a645ba8a5a64a598301ef1, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.563263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.580608 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 61/126] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:37 2022] PUT /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/576d89f5c5a645ba8a5a64a598301ef1/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:37.581276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.626077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.639274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.661825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6849-c0f5-4470-9ce5-dac48054e882 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.704950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.705694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.706087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.706570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.707473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:37.707882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.709454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.720231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 66/127] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:37.721288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.740863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8270e4-5c82-4f6d-ab8a-99fe08dd6d98 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.785714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.786846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.787324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.787756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/81d8701e76e24867a0ae6f975b85ab36/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.790010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e456a52276f4fc6af10bdd5f459c921, user_id=81d8701e76e24867a0ae6f975b85ab36, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.791659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.818607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 62/128] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:37 2022] PUT /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/81d8701e76e24867a0ae6f975b85ab36/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:37.819504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.847902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2020b-9901-4ed1-8f89-915db52de48c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:37.886344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:37.887034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:37.887318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:37.887601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:37.888366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:37.888676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:37.890125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:37.899304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 67/129] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:37.899968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:37.918339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.933226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:37.958081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223768-248f-42da-8139-73e5b19e8d91 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.000231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.001177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.001474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.001803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.003153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.004719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.006522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 63/130] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:38.007428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.021337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ad44-f200-4e89-963f-31629a441ac6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.057428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.058949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.059372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.059784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.061161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.062928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.064818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 68/131] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:37 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:38.065856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.154336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf371c9-dd53-4c0b-bf88-ab2e2dcf73ea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.163268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:38.187933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e86696-9677-4d1d-b100-5b0c2a4e9262 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.201592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.202517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.202801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.203081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.204625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.206678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.209061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 64/132] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:38 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:38.211756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.233645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.234702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.235200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.235636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.236650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] RBAC: Adding query filter params (role.id=f75fb04d0e774fcf9fc11883ae4eb057, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=498a952dd4bb43d28aec0c3ed9b95d83) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:38.237122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.238791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.242238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:38.249719 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 69/133] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:38 2022] GET /identity/v3/role_assignments?user.id=498a952dd4bb43d28aec0c3ed9b95d83&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=f75fb04d0e774fcf9fc11883ae4eb057 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:38.251058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.346378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390797e-cdfb-413b-8405-8fe05174405a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.389520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa770f9-48a6-49c7-a4f2-988d650bf1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.390601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa770f9-48a6-49c7-a4f2-988d650bf1dd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.391004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa770f9-48a6-49c7-a4f2-988d650bf1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.391680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa770f9-48a6-49c7-a4f2-988d650bf1dd None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.393287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa770f9-48a6-49c7-a4f2-988d650bf1dd None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.395461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa770f9-48a6-49c7-a4f2-988d650bf1dd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.397521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 65/134] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:38 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:38.399078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9e8c0-d46c-4b49-9ba6-f4d37f8f4ddb None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.399730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9e8c0-d46c-4b49-9ba6-f4d37f8f4ddb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.400108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9e8c0-d46c-4b49-9ba6-f4d37f8f4ddb None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.402601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 66/135] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:38.403688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9e8c0-d46c-4b49-9ba6-f4d37f8f4ddb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.495119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed80c-5436-49a1-8660-8a847819294d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.538386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81cc71-95c7-4f40-a734-66012e3fbde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.539287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cc71-95c7-4f40-a734-66012e3fbde1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.539564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cc71-95c7-4f40-a734-66012e3fbde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.539846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cc71-95c7-4f40-a734-66012e3fbde1 None admin] PATH_INFO: `/v3/projects/00553edd86414054a8aabe84f8afdeea` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.541125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81cc71-95c7-4f40-a734-66012e3fbde1 None admin] RBAC: Authorizing `identity:get_project(project_id=00553edd86414054a8aabe84f8afdeea)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.542836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81cc71-95c7-4f40-a734-66012e3fbde1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.544739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 70/136] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:38 2022] GET /identity/v3/projects/00553edd86414054a8aabe84f8afdeea => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:38.545988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.546279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.546555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.565930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:38.577937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9e8c0-d46c-4b49-9ba6-f4d37f8f4ddb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.585638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:38.585638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:38.586184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:38.651013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.651971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.652252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:38.652525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/576d89f5c5a645ba8a5a64a598301ef1/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:38.658606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e456a52276f4fc6af10bdd5f459c921, user_id=576d89f5c5a645ba8a5a64a598301ef1, role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:38.660102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:38.683802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 67/137] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:38 2022] PUT /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/576d89f5c5a645ba8a5a64a598301ef1/roles/8206853c3da544e6afa9c839366fd552 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:42:38.684487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.719602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 71/138] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:38.769349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:38.908344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517b91-926c-4d16-a444-025a8002ab76 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.982495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cca65-4a86-40d7-8b9b-961d76429caf None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:38.998556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:38.999550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:38.999839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:39.000118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] PATH_INFO: `/v3/projects/00553edd86414054a8aabe84f8afdeea/users/576d89f5c5a645ba8a5a64a598301ef1/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:39.002338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=00553edd86414054a8aabe84f8afdeea, user_id=576d89f5c5a645ba8a5a64a598301ef1, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:39.003867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:39.027393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 68/139] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:38 2022] PUT /identity/v3/projects/00553edd86414054a8aabe84f8afdeea/users/576d89f5c5a645ba8a5a64a598301ef1/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:39.044940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35b8b4-eeef-42fd-8bb1-7a56e50d8fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:39.045849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35b8b4-eeef-42fd-8bb1-7a56e50d8fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:39.046142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35b8b4-eeef-42fd-8bb1-7a56e50d8fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:39.046424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35b8b4-eeef-42fd-8bb1-7a56e50d8fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:39.047708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35b8b4-eeef-42fd-8bb1-7a56e50d8fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:39.049459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35b8b4-eeef-42fd-8bb1-7a56e50d8fa9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:39.051571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 72/140] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:39.058846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:39.063194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:39.185059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e48e4-b66f-4b14-b50d-bb4edd5bcea7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:39.221388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cc3dd-eaf2-43aa-8775-003c5edac15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:39.222182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cc3dd-eaf2-43aa-8775-003c5edac15e None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:39.222391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cc3dd-eaf2-43aa-8775-003c5edac15e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:39.222670 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cc3dd-eaf2-43aa-8775-003c5edac15e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:39.223412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cc3dd-eaf2-43aa-8775-003c5edac15e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:39.224913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cc3dd-eaf2-43aa-8775-003c5edac15e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:39.258397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 69/141] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:39 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:40.078968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824540f-650b-45b2-9d16-dbc7fd7de3a2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.079483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824540f-650b-45b2-9d16-dbc7fd7de3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.079580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824540f-650b-45b2-9d16-dbc7fd7de3a2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.081104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 73/142] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:40.086504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.086803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.087091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.107659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:40.108891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:40.189005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:40.204575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:40.230223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824540f-650b-45b2-9d16-dbc7fd7de3a2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:40.242405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:40.343612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824540f-650b-45b2-9d16-dbc7fd7de3a2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:40.382911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808214-1712-48f0-89de-fe27ddb7a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:40.383728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808214-1712-48f0-89de-fe27ddb7a463 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.384015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808214-1712-48f0-89de-fe27ddb7a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.384307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808214-1712-48f0-89de-fe27ddb7a463 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.396072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed808214-1712-48f0-89de-fe27ddb7a463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-ed808214-1712-48f0-89de-fe27ddb7a463 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:40.404628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:40.405455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:40.406254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 74/144] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:40.413259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:40.468690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d177-07ea-4b0a-9f63-6f7aeafddfa5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.469308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d177-07ea-4b0a-9f63-6f7aeafddfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.469822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1d177-07ea-4b0a-9f63-6f7aeafddfa5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.471463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 75/145] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:42:40.477213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.477792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.478282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.507071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:40.508663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:40.645993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:40.656300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 76/146] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:40.673465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eec89-7c86-4dc1-befe-7bb7f4b47b70 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:40.700383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:40.758414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:40.759126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.759424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.759701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.760559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:40.760871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:40.762353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:40.780299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 71/147] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:40.785954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:40.878972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbf0d3-74b8-45d0-a7da-aeefbf219c39 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:40.931299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:40.933724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:40.934019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:40.934303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:40.954247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:40.962086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:40.962968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:40.964094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 77/148] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:40.966975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:40.970345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.026397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f601-822b-4de1-b72f-3331d0dbe944 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.058033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:41.083316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.084229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.084513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.084789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.086590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.088884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.090832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 72/149] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:40 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:41.115042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.124563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af452c4-7fb8-4d5e-853c-5c381b7e49ad None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.179796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.180407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.180702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.180984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.181800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:41.182115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.184354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.202356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 78/150] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:41.207942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.239327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1c2c-b216-4475-9c48-838b8dc50970 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.269669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:41.292000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e362eaa-6f65-4297-b841-b8f5ac2f2678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.292671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362eaa-6f65-4297-b841-b8f5ac2f2678 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.292964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362eaa-6f65-4297-b841-b8f5ac2f2678 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.293245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362eaa-6f65-4297-b841-b8f5ac2f2678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.386192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c58c-5a10-4064-bb05-6bb518dce1ab None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.397209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e362eaa-6f65-4297-b841-b8f5ac2f2678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.398728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e362eaa-6f65-4297-b841-b8f5ac2f2678 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.430078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:41.450418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.451349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.451643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.451926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] PATH_INFO: `/v3/users/81d8701e76e24867a0ae6f975b85ab36` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.454427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] RBAC: Authorizing `identity:get_user(user_id=81d8701e76e24867a0ae6f975b85ab36)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.455936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.457652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 79/151] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:41 2022] GET /identity/v3/users/81d8701e76e24867a0ae6f975b85ab36 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:41.466653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.557038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 73/152] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:41.558516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77516-37af-4184-a91e-7cba50975eb9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.558802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77516-37af-4184-a91e-7cba50975eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.559078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77516-37af-4184-a91e-7cba50975eb9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.560695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 74/153] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:41.567667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.567824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.568044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.597290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:41.603239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:41.635079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1248-be27-4afc-86a3-0396be3173af None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.635776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:41.713518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 75/154] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:41.714691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.722355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.723048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.723343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.723625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.858284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b56ba-228c-4fe7-b137-b53170dc8a57 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.895091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:41.902099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.903081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.903260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.903514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.904742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.906252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.908189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 76/155] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:41 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:41.908763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.930718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.932617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.933991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:42.011293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b1652-7108-4299-ad86-6637447c34fa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.047136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.047963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.048246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.048516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.065895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:42.076880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:42.077990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 77/156] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:42.079434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.131140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 80/157] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:42.132041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.209971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:42.257469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cc59c-adcc-4bcc-b329-414ef070f5e5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.294331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:42.319731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693303-9fb0-4e91-abe8-266c9a39118d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.323692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.324372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.324813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.325237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.326272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=576d89f5c5a645ba8a5a64a598301ef1) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:42.326741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:42.328366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:42.339816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 78/158] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:42 2022] GET /identity/v3/role_assignments?user.id=576d89f5c5a645ba8a5a64a598301ef1&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=74a02bd410af491aba0207712ba4d774 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:42.340890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.423746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.424852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.425352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.425851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.426830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:42.427341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:42.428975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:42.448039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 81/159] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:42.454492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.509284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb920d-5d3f-40e4-91a1-a7c94b357d1f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.579121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.579947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.580231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.580507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.581756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:42.583231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:42.584969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 79/160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:42 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:42.606746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.628350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:42.662187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb68dd2-4f94-447d-a2eb-4491af9af93b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.718416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.719588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.720015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.720466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] PATH_INFO: `/v3/users/498a952dd4bb43d28aec0c3ed9b95d83` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.721956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] RBAC: Authorizing `identity:get_user(user_id=498a952dd4bb43d28aec0c3ed9b95d83)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:42.723571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:42.725422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 82/161] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:42 2022] GET /identity/v3/users/498a952dd4bb43d28aec0c3ed9b95d83 => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:42.731424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.772708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d471b-07ad-4fab-98f6-4bb360a30767 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.778004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:42.827268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.828212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.828637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.829181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.830225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=81d8701e76e24867a0ae6f975b85ab36) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:42.830693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:42.832312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:42.846373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 80/162] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:42 2022] GET /identity/v3/role_assignments?user.id=81d8701e76e24867a0ae6f975b85ab36&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:42.897790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c036b9-9268-4df8-9309-47c2fcda9b2c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:42.944589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84dfcf-b6c2-4f61-8e1b-2f9e176ac573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:42.945479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84dfcf-b6c2-4f61-8e1b-2f9e176ac573 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.945799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84dfcf-b6c2-4f61-8e1b-2f9e176ac573 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.946086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84dfcf-b6c2-4f61-8e1b-2f9e176ac573 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.950548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84dfcf-b6c2-4f61-8e1b-2f9e176ac573 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:42.952072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84dfcf-b6c2-4f61-8e1b-2f9e176ac573 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:42.954306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 83/163] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:42 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:42.961452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:42.981646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bb4d-b204-4390-8051-dc9f1e1335a9 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.982199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bb4d-b204-4390-8051-dc9f1e1335a9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.982610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bb4d-b204-4390-8051-dc9f1e1335a9 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:42.984148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 84/164] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:42:42.990686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045216c-6f6c-4f93-91a0-412575bee1db None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:42.991232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045216c-6f6c-4f93-91a0-412575bee1db None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:42.991521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045216c-6f6c-4f93-91a0-412575bee1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.013011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6045216c-6f6c-4f93-91a0-412575bee1db None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:43.014619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6045216c-6f6c-4f93-91a0-412575bee1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:43.101333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 85/165] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:43.105628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2dec-0ae5-4932-a1a0-40c17f5b4bd5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.106525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2dec-0ae5-4932-a1a0-40c17f5b4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.107002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2dec-0ae5-4932-a1a0-40c17f5b4bd5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.113062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 86/166] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:43.115077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50049c0-f456-4822-8b93-007ada750390 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.115572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50049c0-f456-4822-8b93-007ada750390 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.116143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50049c0-f456-4822-8b93-007ada750390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.131745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:43.154897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d50049c0-f456-4822-8b93-007ada750390 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:43.156767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d50049c0-f456-4822-8b93-007ada750390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:43.173856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0891f-6a63-4a0b-92a6-2b4dc24e4cdd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:43.175705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:43.234082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 87/167] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:43.234346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:43.235390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50049c0-f456-4822-8b93-007ada750390 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:43.235492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.235728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.236015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/498a952dd4bb43d28aec0c3ed9b95d83/roles/f75fb04d0e774fcf9fc11883ae4eb057` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.238375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] RBAC: Authorizing `identity:create_grant(project_id=6e456a52276f4fc6af10bdd5f459c921, user_id=498a952dd4bb43d28aec0c3ed9b95d83, role_id=f75fb04d0e774fcf9fc11883ae4eb057)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:43.240225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:43.267293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 81/168] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:42 2022] PUT /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921/users/498a952dd4bb43d28aec0c3ed9b95d83/roles/f75fb04d0e774fcf9fc11883ae4eb057 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:43.337402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:43.370090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50049c0-f456-4822-8b93-007ada750390 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:43.444337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:43.444700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.444878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.445166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.469294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:43.482889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:43.484018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:43.484768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:43.493808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 88/169] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:42:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:43.503751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:43.518263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:43.591759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d975-1f70-4216-88d0-cd913a08874f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:43.650274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48115369-2012-421d-8bd3-916c0247d633 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:43.678375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:43.679235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.679485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.679761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.685973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:43.701580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:43.703439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:43.704130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.704413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.704691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.705464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:43.705844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:43.707329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:43.716502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:43.717527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:43.718777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 82/170] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:43.722813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 89/171] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:43.726711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:43.728356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:43.808838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:43.855282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210655f-3122-498d-ac68-be36c4532084 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:43.892391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3a327-384d-4de9-9a3c-239a52a3eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:43.893413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3a327-384d-4de9-9a3c-239a52a3eff9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.893727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3a327-384d-4de9-9a3c-239a52a3eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.894001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3a327-384d-4de9-9a3c-239a52a3eff9 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.895504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3a327-384d-4de9-9a3c-239a52a3eff9 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:43.897146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3a327-384d-4de9-9a3c-239a52a3eff9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:43.898834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 90/172] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:43 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:43.900012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca07e-531f-40d2-a223-81be10591adc None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:43.900352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca07e-531f-40d2-a223-81be10591adc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:43.901110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca07e-531f-40d2-a223-81be10591adc None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:43.906933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 91/173] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:43.907733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca07e-531f-40d2-a223-81be10591adc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:43.949534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34715dd-f3d4-41c6-a5a5-24219e8c8c75 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.019701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca07e-531f-40d2-a223-81be10591adc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.062712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e2793-b67c-42fd-8cd3-6b801d18b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.063386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e2793-b67c-42fd-8cd3-6b801d18b969 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.063670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e2793-b67c-42fd-8cd3-6b801d18b969 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.063942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e2793-b67c-42fd-8cd3-6b801d18b969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.065238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.065946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.066261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.066535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.067309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:44.067616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.069160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d2c2f-a817-471c-a16c-c632198042f4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.086065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.093678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 83/174] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:44.095282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.095568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.095846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.135941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:44.137150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:44.191688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e2793-b67c-42fd-8cd3-6b801d18b969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.193321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e2793-b67c-42fd-8cd3-6b801d18b969 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.244420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.263186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 84/175] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:44.264164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.327282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 92/176] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:44.328745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d36f-cb33-48cc-84a3-e890fcf4f5d2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.329099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d36f-cb33-48cc-84a3-e890fcf4f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.329445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d36f-cb33-48cc-84a3-e890fcf4f5d2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.330959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 93/177] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:44.331778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d36f-cb33-48cc-84a3-e890fcf4f5d2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.372600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.401972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ed41-80e1-4c44-8d7e-44d0332a1409 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.443120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d36f-cb33-48cc-84a3-e890fcf4f5d2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.446816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.447816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.448132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.448490 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] PATH_INFO: `/v3/users/576d89f5c5a645ba8a5a64a598301ef1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.449842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] RBAC: Authorizing `identity:get_user(user_id=576d89f5c5a645ba8a5a64a598301ef1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.451333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.453588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 85/178] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/users/576d89f5c5a645ba8a5a64a598301ef1 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:44.454430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.488606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051637-c611-44aa-96a3-6776c67fd41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.489950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051637-c611-44aa-96a3-6776c67fd41c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.490335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051637-c611-44aa-96a3-6776c67fd41c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.490702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051637-c611-44aa-96a3-6776c67fd41c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.502975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68051637-c611-44aa-96a3-6776c67fd41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-68051637-c611-44aa-96a3-6776c67fd41c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:44.511354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:44.512922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:44.514689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 94/179] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:44.517020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.517020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.517020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.526486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.536453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:44.537823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:44.577088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262dae1-0176-4e45-b059-b487cc83b764 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.612845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 95/180] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:44.613626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.614166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.615868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.616289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.616715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.618115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.619765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.622042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 86/181] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:44.627656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.643208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.721849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bceb7-d106-4257-a316-6bad7ad62430 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.729892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdc57c-cf03-4b3f-a3bd-264056335486 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.755087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.762376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855663e-3f8a-4fed-8f25-d3be66677aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.763055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855663e-3f8a-4fed-8f25-d3be66677aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.763345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855663e-3f8a-4fed-8f25-d3be66677aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.763628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855663e-3f8a-4fed-8f25-d3be66677aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.770954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.771865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.772725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.773188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.774342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:44.775153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.777127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.788775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 87/182] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:44.790104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.839194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855663e-3f8a-4fed-8f25-d3be66677aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.840736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855663e-3f8a-4fed-8f25-d3be66677aa6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.872459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:44.917194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08100842-48b0-4be6-a48f-17987214c0a0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.955153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.955824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.956110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.956393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.957245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] RBAC: Adding query filter params (role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=576d89f5c5a645ba8a5a64a598301ef1) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:44.957562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.959067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.967634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 96/183] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:44.967634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a1f2-787d-4592-84a7-2ec1945b5fd7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.967634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a1f2-787d-4592-84a7-2ec1945b5fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.967634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a1f2-787d-4592-84a7-2ec1945b5fd7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.967634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 97/184] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:44.967634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768a1f2-787d-4592-84a7-2ec1945b5fd7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.972155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 88/185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/role_assignments?user.id=576d89f5c5a645ba8a5a64a598301ef1&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=8206853c3da544e6afa9c839366fd552 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:44.979447 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.040550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.084423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768a1f2-787d-4592-84a7-2ec1945b5fd7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.101437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389450ff-bcef-4369-a8c3-5cb3eca57bdb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.114764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.125922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.126933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.127065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.127348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.129014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.130525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.137239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 98/186] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:45.138219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.148780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedae85-75b6-49fc-838a-2257678aa6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.149699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedae85-75b6-49fc-838a-2257678aa6fc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.149984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedae85-75b6-49fc-838a-2257678aa6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.150257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedae85-75b6-49fc-838a-2257678aa6fc None admin] PATH_INFO: `/v3/users/cb124d718b444d74801e43d4921907d7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.165511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedae85-75b6-49fc-838a-2257678aa6fc None admin] RBAC: Authorizing `identity:get_user(user_id=cb124d718b444d74801e43d4921907d7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.167180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedae85-75b6-49fc-838a-2257678aa6fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.169114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 89/187] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/users/cb124d718b444d74801e43d4921907d7 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:45.173523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.173523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.173523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.191991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:45.193218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:45.273736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526acca5-1f7c-4024-a7cc-399e35b5af31 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.275340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 90/188] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:45.276250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.316170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.317076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.317360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.317662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] PATH_INFO: `/v3/projects/00553edd86414054a8aabe84f8afdeea` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.318895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=00553edd86414054a8aabe84f8afdeea)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.320377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.322156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 99/189] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/projects/00553edd86414054a8aabe84f8afdeea => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:45.323038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.329952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.392981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.398535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bbc9d-2f26-4795-8589-e09b14582b9f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.434190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a41f2-9435-4ce8-8162-80025ee2b8d7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.434457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.435215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.435491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.435855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.436475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.437964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.469653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 91/190] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:45 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:45.469653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.484903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.485753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.486260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.486601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.584515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.587022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.587524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.606449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1a99a-ebe5-4170-8e50-f9289dd79534 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.646916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.647856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.648209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.648981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.668923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:45.676278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:45.677163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:45.678105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 92/191] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:45.679053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.679569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.733276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 100/192] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:45.734653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.810418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efb92-fe4c-41c8-989f-32e62af43a95 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.860859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.861667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.861891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.862166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.863140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=00553edd86414054a8aabe84f8afdeea, user.id=576d89f5c5a645ba8a5a64a598301ef1) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:45.863470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.865390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.870495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9969cc-7308-487c-9530-0d469c219d87 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:45.872556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 93/193] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/role_assignments?user.id=576d89f5c5a645ba8a5a64a598301ef1&scope.project.id=00553edd86414054a8aabe84f8afdeea&role.id=74a02bd410af491aba0207712ba4d774 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:45.873213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.897440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:45.919780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:45.920738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.920738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.921019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.921917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:45.922152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:45.923586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b581-4627-4216-bd17-85f12f003f27 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:45.933193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 101/194] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:45.934777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ba76-06a4-424f-8eca-a0d8149542cb None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:45.935074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ba76-06a4-424f-8eca-a0d8149542cb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:45.935356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ba76-06a4-424f-8eca-a0d8149542cb None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:45.936830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 102/195] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:45.941541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ba76-06a4-424f-8eca-a0d8149542cb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:45.975673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:46.032341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe49b0-134b-47be-a0b6-9e05e0a44df1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.074040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0367a6b-e550-402d-875c-bf36e784a9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:46.075030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367a6b-e550-402d-875c-bf36e784a9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.075326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367a6b-e550-402d-875c-bf36e784a9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.075604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367a6b-e550-402d-875c-bf36e784a9d8 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.078281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0367a6b-e550-402d-875c-bf36e784a9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:46.079795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0367a6b-e550-402d-875c-bf36e784a9d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:46.081922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 94/196] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:46.083150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.083435 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.083709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.103476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ba76-06a4-424f-8eca-a0d8149542cb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.107375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:46.108591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:46.149332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:46.150672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.151166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.151621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] PATH_INFO: `/v3/users/cb124d718b444d74801e43d4921907d7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.154163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] RBAC: Authorizing `identity:get_user(user_id=cb124d718b444d74801e43d4921907d7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:46.159121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:46.165958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 103/197] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:45 2022] GET /identity/v3/users/cb124d718b444d74801e43d4921907d7 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:46.166683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:46.196184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 95/198] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:46.196905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:46.234788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:46.297895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:46.311149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619df49e-c15f-447e-8162-fc3bd4ce1338 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.342338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dff531-0b6d-4b14-981f-44ccd39cd8ef None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.353399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:46.354899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.355553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.356070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.357065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=cb124d718b444d74801e43d4921907d7) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:46.357688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:46.359950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:46.368905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 104/199] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:46 2022] GET /identity/v3/role_assignments?user.id=cb124d718b444d74801e43d4921907d7&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:46.370278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:46.402890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:46.403642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.404164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.404378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.494397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4b80-2687-41b6-a752-e4d91e3304fa None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.537149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:46.537689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:46.538455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.538866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.539278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.539680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:46.554181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:46.556391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:46.576831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:46.577977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:46.578780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:46.580954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 105/200] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:46.588181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:46.647038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:46.747119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 96/201] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:46.752613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:46.796301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14093a2-d618-4d3c-ab51-ec25903aac1f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.844934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:46.845631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:46.846011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:46.846287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:46.847276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:46.847585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:46.849004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:46.857955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 106/202] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:46.863892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:46.958013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:46.977294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b62c-63ab-40e1-91df-1fe02734c304 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.981794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac95ac-853f-4730-9c1a-9a0f5ae3a7df None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:46.995163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:47.018886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.019799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.020084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.020364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] PATH_INFO: `/v3/users/498a952dd4bb43d28aec0c3ed9b95d83` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.021623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] RBAC: Authorizing `identity:get_user(user_id=498a952dd4bb43d28aec0c3ed9b95d83)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.023128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.026000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 107/203] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:46 2022] GET /identity/v3/users/498a952dd4bb43d28aec0c3ed9b95d83 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:47.032399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:47.062698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.063689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.065628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.065990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.068482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.070087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.074748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 97/204] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:46 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:47.082590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:47.181552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e24d8-212a-4622-9518-d31c3377ec04 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:47.225694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.226586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.226941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.227295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.257943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:47.316708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04f6c6-d410-4a9a-a56d-396121e2ad8f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:47.366768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.368311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.369516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.370541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.370997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.371442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.372457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] RBAC: Adding query filter params (role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=cb124d718b444d74801e43d4921907d7) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:47.372958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.374720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.381256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 98/205] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:47 2022] GET /identity/v3/role_assignments?user.id=cb124d718b444d74801e43d4921907d7&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=8206853c3da544e6afa9c839366fd552 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:47.524218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 108/206] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:47.530586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:47.606912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:47.670325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fca36-7f23-4592-b374-387cb20e90a6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:47.712648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50688e-7284-46a9-952c-e34d9e67770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.713650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50688e-7284-46a9-952c-e34d9e67770c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.714068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50688e-7284-46a9-952c-e34d9e67770c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.714320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50688e-7284-46a9-952c-e34d9e67770c None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.715767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50688e-7284-46a9-952c-e34d9e67770c None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.717266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50688e-7284-46a9-952c-e34d9e67770c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.719396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 99/207] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:47 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:47.726923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:47.789954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:47.861709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e351-8f7a-4b7c-b388-1441eff5db7e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:47.912712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.913388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.913697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.913979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.914836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] RBAC: Adding query filter params (role.id=f75fb04d0e774fcf9fc11883ae4eb057, scope.project.id=6e456a52276f4fc6af10bdd5f459c921, user.id=498a952dd4bb43d28aec0c3ed9b95d83) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:47.915146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.916642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feec3c-593c-4047-9c1b-1ca4a2a63c8d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.926640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 109/208] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:47 2022] GET /identity/v3/role_assignments?user.id=498a952dd4bb43d28aec0c3ed9b95d83&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=f75fb04d0e774fcf9fc11883ae4eb057 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:48.034880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295922b-2a86-4427-b041-b3f8d257361e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.035865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295922b-2a86-4427-b041-b3f8d257361e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.036340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295922b-2a86-4427-b041-b3f8d257361e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.038241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 100/209] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:48.044146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6870b-cad5-4977-9e0e-04c655f01344 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.044451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6870b-cad5-4977-9e0e-04c655f01344 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.044711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6870b-cad5-4977-9e0e-04c655f01344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.072053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f2c6870b-cad5-4977-9e0e-04c655f01344 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:48.073416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f2c6870b-cad5-4977-9e0e-04c655f01344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:48.165950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 110/210] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:48.189962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295922b-2a86-4427-b041-b3f8d257361e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:48.311390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295922b-2a86-4427-b041-b3f8d257361e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:48.325023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d97f1-69a2-45f4-8505-6af17e938f08 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.325340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d97f1-69a2-45f4-8505-6af17e938f08 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.325584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d97f1-69a2-45f4-8505-6af17e938f08 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.327114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 111/211] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:42:48.333464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.333783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.334062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.337771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:48.354669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:48.357471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:48.364931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:48.365807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.366095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.366371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.367621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:48.369096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:48.371305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 101/212] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:48.378745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:48.402864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:48.454847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 112/213] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:48.479019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:48.509065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7757bf-9aee-4ce5-8d44-7b17a83e08b0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:48.544823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:48.545510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.545819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.546092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.546810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:48.548332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:48.571902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 102/214] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:48 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:48.592997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30e0da-46e2-480c-be0d-c4a69e926127 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:48.636598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:48.637455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.637785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.638156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.651820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:48.659811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:48.660739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:48.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 113/215] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:48.668470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:48.718875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:48.792269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7a60-cbab-4187-ba95-58b7176fcd49 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:48.828096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:48.828792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.829075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.829355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.830156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:48.830464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:48.831874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809bede-bd5b-425f-9a40-a40ad47aa283 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:48.841445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 103/216] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:48.847123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:48.862985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1be5c-0257-4bb1-9b44-7bf74893d514 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.863316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1be5c-0257-4bb1-9b44-7bf74893d514 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.863552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1be5c-0257-4bb1-9b44-7bf74893d514 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.869815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 104/217] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:42:48.876269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:48.876556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:48.876835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:48.888929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:48.894717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:48.897252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:48.975631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 105/218] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:48.976173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3eae2-a2a6-4474-a6e4-7cf316327733 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:48.999550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.016696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.017614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.018013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.018294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] PATH_INFO: `/v3/users/4dbd485439aa46de8e9fba397eff8e1e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.032954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] RBAC: Authorizing `identity:get_user(user_id=4dbd485439aa46de8e9fba397eff8e1e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.034495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.036061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:49.036571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 114/219] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:48 2022] GET /identity/v3/users/4dbd485439aa46de8e9fba397eff8e1e => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:49.045212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.144384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3994823-66ed-4fa5-8fb4-8ca1b5444daf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.165664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdea493-2c2f-4485-9b97-27623b9057f7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.173958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:49.220358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.221186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.221473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.221774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.230825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.231424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.231712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.231992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.249491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:49.257478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:49.259089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:49.260087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 106/220] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:49.267926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.330868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.332370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.426128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:49.434841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:49.437528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 115/221] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:49.443857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.447048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2add-1229-4ce6-be5b-b181b1d6420c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.484324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.485256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.485711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.486160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.487088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:49.487559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.489146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.503434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 107/222] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:49.505035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.550344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220efdd5-8cd5-4885-b825-30f666eca364 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.623680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.624680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.625040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.625394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.628989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.630714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.632957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 116/223] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:49.638828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.644233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289274-570f-4ea6-9727-f4e206552efa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.679967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.680996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.681367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.681771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] PATH_INFO: `/v3/users/cb124d718b444d74801e43d4921907d7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.683274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] RBAC: Authorizing `identity:get_user(user_id=cb124d718b444d74801e43d4921907d7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.684845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.691172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 108/224] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/users/cb124d718b444d74801e43d4921907d7 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:49.692756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.715937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:49.720682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:49.765162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdfac-b041-4971-bb6e-78453789babc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.799440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbd51f-b1c2-4240-821c-55b810a08c2a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:49.800854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.801734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.802168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.802655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.803712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=4dbd485439aa46de8e9fba397eff8e1e) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:49.804246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.805950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3965-8d26-419f-ab44-71b33e866e19 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.812940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 117/225] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/role_assignments?user.id=4dbd485439aa46de8e9fba397eff8e1e&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=74a02bd410af491aba0207712ba4d774 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:49.814671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4248c06-b722-4cb3-81b2-f4991db69a2e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.815221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4248c06-b722-4cb3-81b2-f4991db69a2e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.815726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4248c06-b722-4cb3-81b2-f4991db69a2e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.817668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 118/226] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:49.823190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.823775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.824247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.843139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:49.844770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:49.851491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:49.852394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:49.852677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:49.852948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:49.858580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:49.860091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:49.862139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 109/227] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:49.868096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:49.924137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 119/228] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:49.975496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:50.063787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:50.079685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:50.103375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00821f-9666-492e-83a4-9f9128b0d38e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.167345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6948e-bd41-4417-b072-4a9a310ac2ec None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.172830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.173835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.174242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.174525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/cb124d718b444d74801e43d4921907d7/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.181313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] RBAC: Authorizing `identity:create_grant(project_id=151cf301e614473faba59cc02f1ddb0a, user_id=cb124d718b444d74801e43d4921907d7, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:50.182994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:50.208067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 110/229] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:49 2022] PUT /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/cb124d718b444d74801e43d4921907d7/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:42:50.234664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.235938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.236457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.236953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.256073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:50.264900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:50.270339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:50.271123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:50.274144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 120/230] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:50.280401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:50.423466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b68cea-c8a0-4195-aadc-70625242c25d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.458735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.459421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.459704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.459985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.460748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:50.461057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:50.462530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:50.472247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 111/231] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:50.477380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:50.598075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33b7d3-5206-4389-bd7e-249ed2d54d2d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.617983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:50.646272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.647168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.647448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.647724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] PATH_INFO: `/v3/users/cb124d718b444d74801e43d4921907d7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.651779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cb124d718b444d74801e43d4921907d7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:50.653309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:50.655074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 121/232] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:50 2022] GET /identity/v3/users/cb124d718b444d74801e43d4921907d7 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:50.660616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:50.674824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:50.767968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820ee4-f473-45c0-b674-dac498dee7c9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.802595 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9ab58-04e0-4e85-9d82-0f6e61e0fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.803477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ab58-04e0-4e85-9d82-0f6e61e0fa7c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.803758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ab58-04e0-4e85-9d82-0f6e61e0fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.804031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ab58-04e0-4e85-9d82-0f6e61e0fa7c None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.805236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9ab58-04e0-4e85-9d82-0f6e61e0fa7c None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:50.806755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9ab58-04e0-4e85-9d82-0f6e61e0fa7c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:50.808603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 112/233] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:50 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:50.814534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:50.939146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525329e8-2f32-4bd7-b29a-5ebf830193a2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.993407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08638bc7-ea21-4fdf-bb91-f0bb92136a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.994377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08638bc7-ea21-4fdf-bb91-f0bb92136a60 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.994780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08638bc7-ea21-4fdf-bb91-f0bb92136a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.995742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08638bc7-ea21-4fdf-bb91-f0bb92136a60 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/cb124d718b444d74801e43d4921907d7/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.998110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08638bc7-ea21-4fdf-bb91-f0bb92136a60 None admin] RBAC: Authorizing `identity:create_grant(project_id=151cf301e614473faba59cc02f1ddb0a, user_id=cb124d718b444d74801e43d4921907d7, role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:50.999609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08638bc7-ea21-4fdf-bb91-f0bb92136a60 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:51.026276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 122/234] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:50 2022] PUT /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/cb124d718b444d74801e43d4921907d7/roles/8206853c3da544e6afa9c839366fd552 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:51.362171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069db3-a6e3-4fbf-9465-7c30ba7508e7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.363185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069db3-a6e3-4fbf-9465-7c30ba7508e7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.363692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069db3-a6e3-4fbf-9465-7c30ba7508e7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.365665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 113/235] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:51.372527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.372820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.373340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.374493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68c7a-94df-4da0-8784-f3e610e3bab5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.374998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68c7a-94df-4da0-8784-f3e610e3bab5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.375481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68c7a-94df-4da0-8784-f3e610e3bab5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.377073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 114/236] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:51.383051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.383686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.384131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.396859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:51.398462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:51.418856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:51.420078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:51.433987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:51.511136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 123/237] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:51.529172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 115/238] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:51.539177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:51.564774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:51.579110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:51.698034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47526503-25f5-4b30-ad9e-1efa80227602 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:51.738013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:51.739871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.740299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.740714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.742494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:51.744185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:51.747281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 116/239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:51.752979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:51.787637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1d499-b334-4bc7-87c0-1bcd7257ed1a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:51.861989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:51.870903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ad1f-3ffc-4239-b58e-6a7059ff76f0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:51.878051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:51.878945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.879228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.879508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.902515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:51.914722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:51.915583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:51.916381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:51.917011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36899-0914-4349-9517-f24851296035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:51.917011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36899-0914-4349-9517-f24851296035 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:51.917011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36899-0914-4349-9517-f24851296035 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:51.917206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36899-0914-4349-9517-f24851296035 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:51.921630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 124/240] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:51.922418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa36899-0914-4349-9517-f24851296035 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:51.923259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:51.924116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa36899-0914-4349-9517-f24851296035 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:51.959317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 117/241] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:51 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:42:51.997911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:52.084193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc4085-9b5b-4633-a25c-04c02884aaf7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:52.135931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:52.137025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:52.137511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:52.138003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:52.138964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:52.139457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:52.141054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:52.153946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 125/242] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:52.159558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36899-0914-4349-9517-f24851296035 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:52.282652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36899-0914-4349-9517-f24851296035 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:52.313341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:52.319186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d5f-b51e-427d-9ec3-b20e76c18b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:52.320502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d5f-b51e-427d-9ec3-b20e76c18b48 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:52.321024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d5f-b51e-427d-9ec3-b20e76c18b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:52.321839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d5f-b51e-427d-9ec3-b20e76c18b48 None admin] PATH_INFO: `/v3/users/e9f2b16305664406ab6b66bd58d2cbbc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:52.336675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074d5f-b51e-427d-9ec3-b20e76c18b48 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f2b16305664406ab6b66bd58d2cbbc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:52.338260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074d5f-b51e-427d-9ec3-b20e76c18b48 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:52.340058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 118/243] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:52 2022] GET /identity/v3/users/e9f2b16305664406ab6b66bd58d2cbbc => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:52.345858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:52.445137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:52.456806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd1b1b-2959-4c32-934a-4337c6bcfcf5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:52.503345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:52.504022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:52.504306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:52.504583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:52.597562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91a7d-6f61-4709-af30-5a4f980bf9ea None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:52.598510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:52.598968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91a7d-6f61-4709-af30-5a4f980bf9ea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:52.602247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:52.604887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91a7d-6f61-4709-af30-5a4f980bf9ea None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:52.606788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 119/244] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:42:52.616730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:52.617348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:52.617875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:52.643298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:52.644846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:52.752245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 120/245] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:52.752971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:52.769468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 126/246] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:52.775041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:52.786419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:52.929286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a8cc-d9f5-4319-9337-70b9ffa25fca None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:52.933751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b61dd1-00ac-4200-8ae0-65979aeef4b9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:52.958758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:52.987834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d445-ad4b-4bcd-994d-48488985c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:52.988730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d445-ad4b-4bcd-994d-48488985c3ae None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:52.989015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d445-ad4b-4bcd-994d-48488985c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:52.989292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d445-ad4b-4bcd-994d-48488985c3ae None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:52.991671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d445-ad4b-4bcd-994d-48488985c3ae None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:52.993174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d445-ad4b-4bcd-994d-48488985c3ae None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:52.995243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 121/247] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:52 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:53.001958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd149bc6-d55e-4427-9683-2aa7c4ef5217 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.002251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd149bc6-d55e-4427-9683-2aa7c4ef5217 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.002534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd149bc6-d55e-4427-9683-2aa7c4ef5217 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.003914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 122/248] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:53.009141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd149bc6-d55e-4427-9683-2aa7c4ef5217 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.014854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f6e8f-b237-49d5-b802-aeb19b6ea17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.015683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6e8f-b237-49d5-b802-aeb19b6ea17f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.015968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6e8f-b237-49d5-b802-aeb19b6ea17f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.016247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6e8f-b237-49d5-b802-aeb19b6ea17f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.041702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f6e8f-b237-49d5-b802-aeb19b6ea17f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b29f6e8f-b237-49d5-b802-aeb19b6ea17f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:53.053886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:53.054827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:53.063559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 127/249] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:53.067133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.068248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.069684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.099758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:53.101100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:53.165054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:53.180311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd149bc6-d55e-4427-9683-2aa7c4ef5217 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:53.207967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 128/250] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:53.208831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.248032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.248718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.249005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.249284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.250199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] RBAC: Adding query filter params (role.id=f75fb04d0e774fcf9fc11883ae4eb057, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=e9f2b16305664406ab6b66bd58d2cbbc) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:53.250516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:53.251990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:53.271401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 123/251] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/role_assignments?user.id=e9f2b16305664406ab6b66bd58d2cbbc&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=f75fb04d0e774fcf9fc11883ae4eb057 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:53.272277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.381528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ff4e-7b0f-49da-a7d6-6854c6980ae7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:53.384058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:53.448159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.448843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.449127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.449404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.450220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:53.450530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:53.451958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:53.474747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 129/252] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:53.482537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.484513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59599bb3-0ca6-4c0a-899f-d2dc6558059e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:53.536577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.537559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.537959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.538294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.553565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:53.562020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:53.562951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:53.563718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 124/253] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:53.570380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.579558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:53.710164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a447-9342-4ec0-916c-40c294dd2934 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:53.721504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e54b-d225-4d94-9af5-6c37b52d2bab None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:53.725257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:53.759233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.759927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.763648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.763963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.764755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:53.765066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:53.766517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:53.788327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 125/254] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:53.795724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.796827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.800077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.800362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.800636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] PATH_INFO: `/v3/users/4dbd485439aa46de8e9fba397eff8e1e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.802680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] RBAC: Authorizing `identity:get_user(user_id=4dbd485439aa46de8e9fba397eff8e1e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:53.807603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:53.809690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 130/255] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/users/4dbd485439aa46de8e9fba397eff8e1e => generated 297 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:53.818733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:54.031434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0f8c5-a15f-4b26-a654-e3ac44ed703c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:54.071272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60fb30-dde7-43d7-84d4-c96c9c0c9c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:54.072165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60fb30-dde7-43d7-84d4-c96c9c0c9c20 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.072444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60fb30-dde7-43d7-84d4-c96c9c0c9c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.072853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60fb30-dde7-43d7-84d4-c96c9c0c9c20 None admin] PATH_INFO: `/v3/users/cb124d718b444d74801e43d4921907d7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.074234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60fb30-dde7-43d7-84d4-c96c9c0c9c20 None admin] RBAC: Authorizing `identity:get_user(user_id=cb124d718b444d74801e43d4921907d7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:54.075708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60fb30-dde7-43d7-84d4-c96c9c0c9c20 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:54.078629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 126/256] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/users/cb124d718b444d74801e43d4921907d7 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:54.081415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95ba4e-a8c8-4f69-ac97-ce05812f280d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:54.084136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54ee3-b4f6-4c2c-84d8-226a50d77999 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.084421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54ee3-b4f6-4c2c-84d8-226a50d77999 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.084696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54ee3-b4f6-4c2c-84d8-226a50d77999 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.086187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 127/257] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:54.086715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54ee3-b4f6-4c2c-84d8-226a50d77999 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:54.109460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:54.146030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7d8c2-9654-4e68-8480-c17ba84b4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:54.146915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d8c2-9654-4e68-8480-c17ba84b4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.147194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d8c2-9654-4e68-8480-c17ba84b4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.147466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d8c2-9654-4e68-8480-c17ba84b4b05 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.151083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d8c2-9654-4e68-8480-c17ba84b4b05 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:54.152684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d8c2-9654-4e68-8480-c17ba84b4b05 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:54.154450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 131/258] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:54.155595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.155878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.156154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.183137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:54.184164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:54.188640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:54.301024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54ee3-b4f6-4c2c-84d8-226a50d77999 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:54.317568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 132/259] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:54.318277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:54.369187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:54.370427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.370927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.371426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.511262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955366cb-cd14-4b37-8182-8b642bf7179d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:54.522311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:54.523830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:54.538274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:54.584772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:54.585619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.586163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.586605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/4dbd485439aa46de8e9fba397eff8e1e/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.590768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] RBAC: Authorizing `identity:create_grant(project_id=151cf301e614473faba59cc02f1ddb0a, user_id=4dbd485439aa46de8e9fba397eff8e1e, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:54.593486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:54.593992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:54.616625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 133/260] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:54 2022] PUT /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/4dbd485439aa46de8e9fba397eff8e1e/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:54.618832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:54.697230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 128/261] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:54.706728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:54.831101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f30-dbdb-43c7-94e7-350f35829185 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:54.902501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badf7d9-5874-4436-b7ee-c4eaa1a11fcd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:54.907913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:54.908776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.909064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.909350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.926963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:54.935634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:54.936585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:42:54.937421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:54.941836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 134/262] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:54.943506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:54.984805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e278f-792e-4213-b734-0ab8203b8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:54.985879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e278f-792e-4213-b734-0ab8203b8aca None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.986015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:54.986092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e278f-792e-4213-b734-0ab8203b8aca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.986325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e278f-792e-4213-b734-0ab8203b8aca None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.987750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e278f-792e-4213-b734-0ab8203b8aca None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:54.989359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e278f-792e-4213-b734-0ab8203b8aca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:54.991916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 129/263] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:54 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:54.993359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6008a3e-b521-4320-a9b7-4798780410ce None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:54.993698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6008a3e-b521-4320-a9b7-4798780410ce None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:54.994050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6008a3e-b521-4320-a9b7-4798780410ce None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:54.995794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 130/264] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:55.003689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.010178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.010178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.024371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:55.025546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:55.029838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:55.090548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d4eba-e9b3-4bae-8dea-e16d47837f8a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:55.112598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 131/265] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:55.113298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:55.146508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:55.147195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.147478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.147756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.148784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:55.149091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:55.150957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:55.168722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 135/266] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:42:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:55.169565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:55.301017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0a1b2-746f-460a-b8db-644cf6fc18e7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:55.328582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:55.336881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:55.337558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.337867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.338162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.339177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=cb124d718b444d74801e43d4921907d7) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:55.339486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:55.339671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193e46d-93e9-4fe2-bf0c-833268cdf476 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:55.340979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:55.347770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 132/267] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:55 2022] GET /identity/v3/role_assignments?user.id=cb124d718b444d74801e43d4921907d7&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:55.348591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:55.354133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:55.409690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54651-1121-41e2-858e-d105ef161707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:55.410588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54651-1121-41e2-858e-d105ef161707 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.410876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54651-1121-41e2-858e-d105ef161707 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.411156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54651-1121-41e2-858e-d105ef161707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.412476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54651-1121-41e2-858e-d105ef161707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:55.414052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54651-1121-41e2-858e-d105ef161707 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:55.416082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 136/268] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:55.417422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823319f5-f203-42ef-b4bb-464915fad6c7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.417821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823319f5-f203-42ef-b4bb-464915fad6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.421584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823319f5-f203-42ef-b4bb-464915fad6c7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.423375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 137/269] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:55.424178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823319f5-f203-42ef-b4bb-464915fad6c7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:55.499812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ff892-3488-43bd-a866-6f2004105270 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:55.574844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9748105-dfd0-4392-b300-670d9d27c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:55.575759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748105-dfd0-4392-b300-670d9d27c43f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.576044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748105-dfd0-4392-b300-670d9d27c43f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.576323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748105-dfd0-4392-b300-670d9d27c43f None admin] PATH_INFO: `/v3/users/cb124d718b444d74801e43d4921907d7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.578368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9748105-dfd0-4392-b300-670d9d27c43f None admin] RBAC: Authorizing `identity:get_user(user_id=cb124d718b444d74801e43d4921907d7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:55.579895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9748105-dfd0-4392-b300-670d9d27c43f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:55.581843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 133/270] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:55 2022] GET /identity/v3/users/cb124d718b444d74801e43d4921907d7 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:55.585910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.586203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.586486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.612363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823319f5-f203-42ef-b4bb-464915fad6c7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:55.618869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:55.620629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:55.651546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:55.652411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.652703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.652984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.653749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:55.655234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:55.681636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 138/271] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:42:55 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:55.682384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:55.702319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:55.716546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 134/272] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:55.767731 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:55.770460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:55.865262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53d626-f8bc-4f1c-937d-e4f07de14507 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:55.935771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:55.938686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:55.939533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:55.940651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:55.979591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeafe6-ab1c-484d-ab17-e2a9409c200a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.021844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef0a2-2aac-4196-95fa-a3e2fafb8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.022665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef0a2-2aac-4196-95fa-a3e2fafb8f58 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.022948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef0a2-2aac-4196-95fa-a3e2fafb8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.023224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef0a2-2aac-4196-95fa-a3e2fafb8f58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.023949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:56.026263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:56.036826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef0a2-2aac-4196-95fa-a3e2fafb8f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:56.042912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-448ef0a2-2aac-4196-95fa-a3e2fafb8f58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:56.046356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:56.047312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:42:56.048280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 135/273] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:42:56.049061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179d1a-4e8f-42dc-aca5-d75ee49d67b7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.049168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179d1a-4e8f-42dc-aca5-d75ee49d67b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.049452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179d1a-4e8f-42dc-aca5-d75ee49d67b7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.050965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 136/274] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:56.056440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.056724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.057057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.076484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:56.076683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:56.153905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:56.154924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 139/275] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:56.155747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.171098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 137/276] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:56.171985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.280181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b0b08-b0dd-4723-aa6e-589ef964bd42 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.295643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:56.297024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe89f5-d823-479d-8ec9-debadb625400 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.317040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.318104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.318584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.319072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.320082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:56.320580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:56.322254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:56.335830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 140/277] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:56.335830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.336403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.337722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.338011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.338353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.339578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:56.341166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:56.343322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 138/278] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:56.344213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.443785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365c4ed-eadd-4d64-a742-1018f373c80e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.480132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.481493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.482082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.482509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.495582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:56.504161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:56.505068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:56.506026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:56.508111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 141/279] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:56.509214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.530787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:56.558225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:56.649257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa2712-0825-4943-aad3-c9c79cd3ed9c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.667641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e9570-9b9b-4041-9a0f-5b105fc65ed4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.693951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.694859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.695144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.695419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] PATH_INFO: `/v3/users/97044e838ee14aafa4887ccd3e2a8e35` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.722093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] RBAC: Authorizing `identity:get_user(user_id=97044e838ee14aafa4887ccd3e2a8e35)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:56.724761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:56.730191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 139/280] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/users/97044e838ee14aafa4887ccd3e2a8e35 => generated 293 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:56.734415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.741493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.742728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.748379 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.748907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.750237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] RBAC: Adding query filter params (role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=cb124d718b444d74801e43d4921907d7) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:56.750791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:56.752633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:56.759834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 142/281] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/role_assignments?user.id=cb124d718b444d74801e43d4921907d7&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=8206853c3da544e6afa9c839366fd552 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:56.761629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:56.880959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:56.886175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865de736-6ce8-4372-b7f2-49c7f509bd62 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:56.946466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:56.947641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.948877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.949413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.950536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, user.id=97044e838ee14aafa4887ccd3e2a8e35, scope.system=all) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:56.951064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:56.952898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:56.961573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 143/282] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/role_assignments?user.id=97044e838ee14aafa4887ccd3e2a8e35&scope.system=all&role.id=74a02bd410af491aba0207712ba4d774 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:57.008685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff073-af46-4f25-ad30-d1a9bef44a25 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:57.043366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:57.072561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:57.073641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.073641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.073951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.074670 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:57.074982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:57.076440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:57.090491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 140/283] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:57.096171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:57.237171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3b2b-2f7c-4a03-aa9b-a40dddca6661 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:57.284241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0941-5f09-4914-aa3d-1f487bf2eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:57.285517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0941-5f09-4914-aa3d-1f487bf2eaac None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.286035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0941-5f09-4914-aa3d-1f487bf2eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.286531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0941-5f09-4914-aa3d-1f487bf2eaac None admin] PATH_INFO: `/v3/users/e9f2b16305664406ab6b66bd58d2cbbc` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.287991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0941-5f09-4914-aa3d-1f487bf2eaac None admin] RBAC: Authorizing `identity:get_user(user_id=e9f2b16305664406ab6b66bd58d2cbbc)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:57.289813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0941-5f09-4914-aa3d-1f487bf2eaac None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:57.292087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 144/284] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:57 2022] GET /identity/v3/users/e9f2b16305664406ab6b66bd58d2cbbc => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:57.302786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:57.445669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc471a-bead-47f6-bcc2-4e813cffbdc1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:57.485498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb97fec-2e9e-4def-bbd7-e81a9a318187 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.486154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb97fec-2e9e-4def-bbd7-e81a9a318187 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.486632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb97fec-2e9e-4def-bbd7-e81a9a318187 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.488551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 145/285] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:57.493679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6627-ef58-4b4e-9aa2-08d0f03ce768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:57.493679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6627-ef58-4b4e-9aa2-08d0f03ce768 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.493679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6627-ef58-4b4e-9aa2-08d0f03ce768 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.493679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6627-ef58-4b4e-9aa2-08d0f03ce768 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.493978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6627-ef58-4b4e-9aa2-08d0f03ce768 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:57.493978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6627-ef58-4b4e-9aa2-08d0f03ce768 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:57.499364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 141/286] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:57 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:57.504752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb97fec-2e9e-4def-bbd7-e81a9a318187 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:57.505279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.505721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.506015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.535452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:57.536662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:57.546030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:57.626959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb97fec-2e9e-4def-bbd7-e81a9a318187 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:57.669750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:57.670678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.670962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.671240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/e9f2b16305664406ab6b66bd58d2cbbc/roles/f75fb04d0e774fcf9fc11883ae4eb057` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.674243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] RBAC: Authorizing `identity:create_grant(project_id=151cf301e614473faba59cc02f1ddb0a, user_id=e9f2b16305664406ab6b66bd58d2cbbc, role_id=f75fb04d0e774fcf9fc11883ae4eb057)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:57.676331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:57.676875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:57.698169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 146/287] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:42:57 2022] PUT /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a/users/e9f2b16305664406ab6b66bd58d2cbbc/roles/f75fb04d0e774fcf9fc11883ae4eb057 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:57.715344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 142/288] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:57.764716 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:57.900289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:57.911059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdef4c-d17b-4c3f-919f-234c0cb7e633 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:57.952271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:57.953097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.953384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.953712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.965137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:57.973036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:57.973920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:57.974676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 147/289] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:57.981184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:58.117355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946d50a-a9c7-4a02-a3ae-6c183fca283c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:58.156870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:58.157564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:58.157876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:58.158146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:58.158912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:58.159219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:58.160672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:58.170454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 143/290] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:58.175762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:58.329352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1deef-f071-4297-bce4-cdb8f4e262b5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:58.378448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339235a9-bf81-47ce-ab6b-50efa1561422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:58.379274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339235a9-bf81-47ce-ab6b-50efa1561422 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:58.379557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339235a9-bf81-47ce-ab6b-50efa1561422 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:58.379837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339235a9-bf81-47ce-ab6b-50efa1561422 None admin] PATH_INFO: `/v3/users/4dbd485439aa46de8e9fba397eff8e1e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:58.381149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339235a9-bf81-47ce-ab6b-50efa1561422 None admin] RBAC: Authorizing `identity:get_user(user_id=4dbd485439aa46de8e9fba397eff8e1e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:58.382670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339235a9-bf81-47ce-ab6b-50efa1561422 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:58.384726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 148/291] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:58 2022] GET /identity/v3/users/4dbd485439aa46de8e9fba397eff8e1e => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:58.390799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:58.466050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:58.537379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e251-1f49-488c-a12e-7451036190a8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:58.587525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:58.588638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:58.589310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:58.589826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:58.668576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa61bbb-279f-4250-b317-4d9b654554df None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:58.669194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa61bbb-279f-4250-b317-4d9b654554df None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:58.669723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa61bbb-279f-4250-b317-4d9b654554df None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:58.675300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 149/292] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:58.677002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:58.677487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:58.678010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:58.697081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:58.699370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:58.722603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:58.725547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:58.727070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:58.808381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:58.831364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 150/293] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:42:58.895231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 144/294] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:58.900366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:58.903422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.031272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf98e66-992c-4d46-b050-c8eebfae99cc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.052969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fad1-10ba-4ac7-98a5-bf441718fda4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.082162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7011-79e4-462b-9c4f-af36f97d605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.083365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7011-79e4-462b-9c4f-af36f97d605b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.084144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7011-79e4-462b-9c4f-af36f97d605b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.084525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7011-79e4-462b-9c4f-af36f97d605b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.093067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e12ecb-a3d8-4d72-a803-e9ca21be35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.093994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12ecb-a3d8-4d72-a803-e9ca21be35b0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.094280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12ecb-a3d8-4d72-a803-e9ca21be35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.094559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12ecb-a3d8-4d72-a803-e9ca21be35b0 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.095774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12ecb-a3d8-4d72-a803-e9ca21be35b0 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.097078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7011-79e4-462b-9c4f-af36f97d605b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:59.097275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12ecb-a3d8-4d72-a803-e9ca21be35b0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.099320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 145/295] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:42:58 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:59.100538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db9c35-94db-4142-b872-ab3d6e1ac0e7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.100824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db9c35-94db-4142-b872-ab3d6e1ac0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.101101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db9c35-94db-4142-b872-ab3d6e1ac0e7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c27d7011-79e4-462b-9c4f-af36f97d605b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:59.105288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:59.106190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:42:59.106972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:59.107576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 146/297] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:59.107643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db9c35-94db-4142-b872-ab3d6e1ac0e7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.111507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 151/297] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:42:59.114040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.114333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.114966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.121455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.137863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:59.139740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:59.143977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.227631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 152/298] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:59.228504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.233789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db9c35-94db-4142-b872-ab3d6e1ac0e7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.296965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.297831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.298123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.298823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.299953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=4dbd485439aa46de8e9fba397eff8e1e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:59.300269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.302660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.311720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 147/299] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:42:59 2022] GET /identity/v3/role_assignments?user.id=4dbd485439aa46de8e9fba397eff8e1e&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=74a02bd410af491aba0207712ba4d774 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:59.313816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.346665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2c5e3-796e-48eb-9c9e-a10037190c5b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.387415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.388192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.389153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.389451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.390701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:59.391022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.392682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d8662-5a3f-4106-b915-39e45e2b7d13 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.405001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 153/300] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:59.406462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc862f-f325-4bef-87aa-084bf53771e8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.406762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc862f-f325-4bef-87aa-084bf53771e8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.407047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc862f-f325-4bef-87aa-084bf53771e8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.408749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 154/301] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:42:59.411686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc862f-f325-4bef-87aa-084bf53771e8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.414944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.418023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.451043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24008768-2e1e-4493-a734-ea754adc4c44 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.488054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3178a6-c1b7-4864-b346-53b185b7fec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.489368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3178a6-c1b7-4864-b346-53b185b7fec2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.490041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3178a6-c1b7-4864-b346-53b185b7fec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.490318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3178a6-c1b7-4864-b346-53b185b7fec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.491632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3178a6-c1b7-4864-b346-53b185b7fec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.493136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3178a6-c1b7-4864-b346-53b185b7fec2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.495499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 148/302] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:59.496273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.496558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.496833 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.514502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:59.515782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:59.535192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc862f-f325-4bef-87aa-084bf53771e8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.581188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.582136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.582419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.582695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] PATH_INFO: `/v3/users/6771164d401445d9905e4d1c798611b1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.599990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 149/303] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:42:59.601173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.605280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] RBAC: Authorizing `identity:get_user(user_id=6771164d401445d9905e4d1c798611b1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.607081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.613434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 155/304] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:42:59 2022] GET /identity/v3/users/6771164d401445d9905e4d1c798611b1 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:42:59.615708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.690245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.693977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.727375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2d396-6ac1-464b-8376-81fb3c6ee86c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.740632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837293c4-6855-4d42-be84-ce264bf92c3d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.768390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.769095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.769377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.769665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] PATH_INFO: `/v3/groups` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.770440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.771968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.777758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.778496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.778776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.779044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.780052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] RBAC: Adding query filter params (role.id=f75fb04d0e774fcf9fc11883ae4eb057, user.id=6771164d401445d9905e4d1c798611b1, scope.system=all) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:59.780365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:59.781996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:59.787858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 156/305] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 23 11:42:59 2022] GET /identity/v3/role_assignments?user.id=6771164d401445d9905e4d1c798611b1&scope.system=all&role.id=f75fb04d0e774fcf9fc11883ae4eb057 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:59.788860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:59.790468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 150/306] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Jun 23 11:42:59 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:59.927408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62ad1b-914e-4599-99ad-ea9d1d13a797 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:59.957126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:59.970825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427370-18c5-41cc-a7ce-96c09356da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:59.971651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427370-18c5-41cc-a7ce-96c09356da0e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:59.971936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427370-18c5-41cc-a7ce-96c09356da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:59.972219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427370-18c5-41cc-a7ce-96c09356da0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:59.984982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427370-18c5-41cc-a7ce-96c09356da0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c2427370-18c5-41cc-a7ce-96c09356da0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:42:59.995442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:42:59.996651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:42:59.998034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 157/307] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:42:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:00.002790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.115769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43fea-3f7e-4c9c-ab39-85317b852829 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:00.132348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d3f8-c8ff-47e0-92e2-bf800d957e14 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.132654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d3f8-c8ff-47e0-92e2-bf800d957e14 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.132909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d3f8-c8ff-47e0-92e2-bf800d957e14 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.134870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 158/308] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:00.142105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.142522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.142895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.152084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:00.156227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:00.157109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.157549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.158025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.158992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:00.159747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:00.161691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:00.162469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:00.163783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:00.172817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 151/309] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:00.182936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.247930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 159/310] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:00.271285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.312155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dd5b7-27d9-484c-bef6-f227eb144d34 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:00.360649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:00.361958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.362431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.362997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] PATH_INFO: `/v3/users/97044e838ee14aafa4887ccd3e2a8e35` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.364741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] RBAC: Authorizing `identity:get_user(user_id=97044e838ee14aafa4887ccd3e2a8e35)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:00.366473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:00.368620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 152/311] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:43:00 2022] GET /identity/v3/users/97044e838ee14aafa4887ccd3e2a8e35 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:00.381723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.401807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a9993-9cd1-4b4a-ba3a-2b816391e107 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:00.422782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:00.446602 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:00.450654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:00.452256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.452547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.452827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.470535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:00.481436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:00.482404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:00.483171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 160/312] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:00.489916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.500170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932561c-c577-41a8-9071-bc26dc613c08 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:00.542839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:00.543824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.544181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.545118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] PATH_INFO: `/v3/system/users/97044e838ee14aafa4887ccd3e2a8e35/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.546782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=97044e838ee14aafa4887ccd3e2a8e35, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:00.549189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:00.566080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 153/313] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jun 23 11:43:00 2022] PUT /identity/v3/system/users/97044e838ee14aafa4887ccd3e2a8e35/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:00.638085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b9129-d82b-40e6-80c6-d258f3c60234 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:00.679341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:00.680443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.680911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.681390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.683137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:00.683639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:00.685289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:00.695484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 161/314] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:00.704328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.817344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9972-9685-4227-b031-89ee281b9f6b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:00.845290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:00.858264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:00.859246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:00.859532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:00.859859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] PATH_INFO: `/v3/users/e9f2b16305664406ab6b66bd58d2cbbc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:00.861126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f2b16305664406ab6b66bd58d2cbbc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:00.862631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:00.864970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 154/315] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:43:00 2022] GET /identity/v3/users/e9f2b16305664406ab6b66bd58d2cbbc => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:00.870697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:00.910051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:00.984278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b26c88-0422-49a2-866d-97025b55c280 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:01.025190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:01.026997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:01.027492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:01.027968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:01.106233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:01.108072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:01.145434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:01.217894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 162/316] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:01.226733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:01.332494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf8fb8-b21d-465a-8ed0-522afd2cc1d5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:01.367980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470d9b9-5f9c-4f89-949a-7dd54449ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:01.369235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470d9b9-5f9c-4f89-949a-7dd54449ed27 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:01.369839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470d9b9-5f9c-4f89-949a-7dd54449ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:01.370305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470d9b9-5f9c-4f89-949a-7dd54449ed27 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:01.371725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470d9b9-5f9c-4f89-949a-7dd54449ed27 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:01.373484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470d9b9-5f9c-4f89-949a-7dd54449ed27 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:01.375844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 155/317] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:01 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:01.381983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:01.488586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4621b6-16dc-4541-b2ae-2a3e85343b88 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:01.526609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:01.527285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:01.527574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:01.527858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:01.528717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] RBAC: Adding query filter params (role.id=f75fb04d0e774fcf9fc11883ae4eb057, scope.project.id=151cf301e614473faba59cc02f1ddb0a, user.id=e9f2b16305664406ab6b66bd58d2cbbc) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:01.529035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:01.530526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709035e-b544-49b0-b67d-607799839a1c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:01.533660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:01.537534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 163/318] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:01 2022] GET /identity/v3/role_assignments?user.id=e9f2b16305664406ab6b66bd58d2cbbc&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=f75fb04d0e774fcf9fc11883ae4eb057 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:01.933010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b30379-998c-4cd4-a4e3-8d754801dc6b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:01.933370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b30379-998c-4cd4-a4e3-8d754801dc6b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:01.933470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b30379-998c-4cd4-a4e3-8d754801dc6b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:01.934930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 156/319] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:01.940399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:01.940697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:01.940979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:01.958354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:01.959529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:02.031325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca6eab-eeda-4a31-840d-3e6f4311abce None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.031640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca6eab-eeda-4a31-840d-3e6f4311abce None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.031894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca6eab-eeda-4a31-840d-3e6f4311abce None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.033392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 157/321] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:02.033660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 164/321] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:02.038249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.038577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.038817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.054843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.056187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:02.058155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:02.122192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:02.136464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 158/322] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:02.159048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.179915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ae09-9bd4-4684-9420-f42739b5d5e2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.211708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:02.218158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.218952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.219244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.219508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.230447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:02.238098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:02.238967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:02.240118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 165/323] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:02.245891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.269916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e2d3b-02a6-4c85-9f8d-743aa979d169 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.306019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.307172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.307457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.307730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.308907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:02.310595 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:02.312241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 159/324] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:02.317766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.353950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf7e6-dafe-4498-9ec2-1795f9c97123 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.378906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:02.389568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.390291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.390575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.390857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.391625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:02.391931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:02.393336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:02.402460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 166/325] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:02.407635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.430734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845a7de-e4dd-4c66-b5df-3f5022a5decd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.472777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:02.473743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.474676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.474676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.474935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] PATH_INFO: `/v3/groups` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.475716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:02.477312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:02.493994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 160/326] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Jun 23 11:43:02 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:43:02.548305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b832-50ad-4352-80b6-b0555e95a51b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.595905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef377c4-fa70-4b8a-aa42-c709aad210c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.596812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef377c4-fa70-4b8a-aa42-c709aad210c3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.597101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef377c4-fa70-4b8a-aa42-c709aad210c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.597383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef377c4-fa70-4b8a-aa42-c709aad210c3 None admin] PATH_INFO: `/v3/users/6771164d401445d9905e4d1c798611b1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.598689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef377c4-fa70-4b8a-aa42-c709aad210c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6771164d401445d9905e4d1c798611b1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:02.602237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef377c4-fa70-4b8a-aa42-c709aad210c3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:02.602417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:43:02 2022] GET /identity/v3/users/6771164d401445d9905e4d1c798611b1 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:02.608199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.699095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d3d0-3f02-4190-9f6d-760112dab457 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.699416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d3d0-3f02-4190-9f6d-760112dab457 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.699660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d3d0-3f02-4190-9f6d-760112dab457 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.701074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 168/328] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:02.706365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.706609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.707060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.724134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:02.725257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:02.727846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc061696-6491-4d4c-af5a-fffefb87aa54 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.748110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:02.768757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.769679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:02.769966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:02.770243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] PATH_INFO: `/v3/system/users/6771164d401445d9905e4d1c798611b1/roles/f75fb04d0e774fcf9fc11883ae4eb057` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:02.771801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6771164d401445d9905e4d1c798611b1, role_id=f75fb04d0e774fcf9fc11883ae4eb057)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:02.773215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:02.783005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 161/329] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Jun 23 11:43:02 2022] PUT /identity/v3/system/users/6771164d401445d9905e4d1c798611b1/roles/f75fb04d0e774fcf9fc11883ae4eb057 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:43:02.808243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 169/330] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:02.832127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:02.958541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d88f2a-a5d6-4b05-86f6-b0bed6599251 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:02.999180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:02.999987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:03.000278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:03.000557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:03.012469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:03.020397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:03.021298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:03.022112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 162/331] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:03.028756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:03.088456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:03.152265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29779100-1b5b-45fe-8a57-713aef1dd7ae None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:03.197520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:03.198408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:03.198690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:03.198972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:03.199763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:03.200066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:03.201474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:03.210981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 170/332] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:03.216797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:03.274756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:03.349424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177ca41-086e-451a-b068-3ed747f7ec06 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:03.390295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0e465-3949-4f6f-bbb0-cc69f2010cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:03.391200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e465-3949-4f6f-bbb0-cc69f2010cbd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:03.391485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e465-3949-4f6f-bbb0-cc69f2010cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:03.391761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0e465-3949-4f6f-bbb0-cc69f2010cbd None admin] PATH_INFO: `/v3/users/97044e838ee14aafa4887ccd3e2a8e35` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:03.392998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0e465-3949-4f6f-bbb0-cc69f2010cbd None admin] RBAC: Authorizing `identity:get_user(user_id=97044e838ee14aafa4887ccd3e2a8e35)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:03.394607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0e465-3949-4f6f-bbb0-cc69f2010cbd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:03.396579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 163/333] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:43:03 2022] GET /identity/v3/users/97044e838ee14aafa4887ccd3e2a8e35 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:03.402447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:03.532582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1f5e6-3f23-452b-8a0f-273baa3a89f4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:03.546198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:03.577920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:03.578600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:03.578889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:03.579171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:03.580033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] RBAC: Adding query filter params (role.id=74a02bd410af491aba0207712ba4d774, user.id=97044e838ee14aafa4887ccd3e2a8e35, scope.system=all) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:03.580351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:03.581853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2823991-49fd-4b7a-a5cc-fff56e2fc798 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:03.597286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 171/334] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 23 11:43:03 2022] GET /identity/v3/role_assignments?user.id=97044e838ee14aafa4887ccd3e2a8e35&scope.system=all&role.id=74a02bd410af491aba0207712ba4d774 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:05.327807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86b0-a5ef-41b6-aa85-cba07e9990e5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.328398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86b0-a5ef-41b6-aa85-cba07e9990e5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.328398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86b0-a5ef-41b6-aa85-cba07e9990e5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.330064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 164/335] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:05.335481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48809e26-b4a2-4141-bc81-306d9f9f082f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.335920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48809e26-b4a2-4141-bc81-306d9f9f082f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.336119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48809e26-b4a2-4141-bc81-306d9f9f082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.359382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-48809e26-b4a2-4141-bc81-306d9f9f082f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:05.360590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48809e26-b4a2-4141-bc81-306d9f9f082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:05.373346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b5aa-9c67-4bfa-8ebe-2eda32301d41 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.373686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b5aa-9c67-4bfa-8ebe-2eda32301d41 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.373950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b5aa-9c67-4bfa-8ebe-2eda32301d41 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.375597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 165/336] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:05.380650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.380933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.381210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.406503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:05.407726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:05.519998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 172/337] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:05.528327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421e97b-3853-4bd3-9943-58f81aafd8b9 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.528638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421e97b-3853-4bd3-9943-58f81aafd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.528899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421e97b-3853-4bd3-9943-58f81aafd8b9 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.531268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 173/338] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:05.536408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.536707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.536997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.564214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 166/339] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:05.568033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:05.569249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:05.603067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:05.662643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:05.687398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 174/340] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 23 11:43:05.688619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:05.731040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:05.769502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb342b-872a-4bc9-9602-b0dde4b5defa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:05.819097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba58dc0-5883-4ba2-be53-c109c899aec5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:05.823162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:05.824004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.824288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.824599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.840374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:05.853285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:05.854541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:05.855338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:05.861636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 167/341] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:05.861636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:05.866032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:05.868443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:05.868954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:05.869585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:05.893439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:05.902635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:05.903516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:05.904270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:05.914358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 175/342] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:05.916311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.065218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.069424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81af918-521d-4dba-a03d-6c0804277902 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.106743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.129104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ee42-6f08-4f0a-96e3-1e856bf1ecd0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.141734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.142561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.142841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.143115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.163688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:06.171859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:06.172768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:06.173564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 168/343] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:06.178610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.195693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.196383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.196674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.196952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.197884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:06.198205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.199722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.220519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 176/344] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:06.223826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.328916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431877f-b715-4f6e-a853-6d19cd175750 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.350569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e107-2af3-46e8-91f2-69b110acd56c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.369042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.369798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.370106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.370388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.371162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:06.371473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.372893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.387495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 169/345] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:06.388676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.392553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.393543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.394066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.394545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.395525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:06.396096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.397812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8feff3-036d-4522-a6ec-e47b4c4d6111 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.408095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 177/346] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:06.409787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1298-b7db-4a28-af4b-f9ba2db006bf None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.410445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1298-b7db-4a28-af4b-f9ba2db006bf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.411011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1298-b7db-4a28-af4b-f9ba2db006bf None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.412740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 178/347] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:06.417666 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e1298-b7db-4a28-af4b-f9ba2db006bf None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.418234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.436640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.521020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7f20f-4157-4637-8d0b-1da509b878c1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.534570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e1298-b7db-4a28-af4b-f9ba2db006bf None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.557692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.558368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.558642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.558986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.572387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5076-af00-4e93-ab79-148a235002de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.573434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5076-af00-4e93-ab79-148a235002de None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.573964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5076-af00-4e93-ab79-148a235002de None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.574454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5076-af00-4e93-ab79-148a235002de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.632845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.634275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.652856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5076-af00-4e93-ab79-148a235002de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.654729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc5076-af00-4e93-ab79-148a235002de None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.660862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.671359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.742780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 170/348] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:06.743939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.768378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 179/349] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:06.770014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.770499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.770957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.791395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:06.792391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:06.886205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 180/350] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:06.887093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.892994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6297e53-f75f-49f9-81a2-11181714fb19 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.922958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.937842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d74096-85cf-4c7c-af4c-0e4198d9d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.938601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d74096-85cf-4c7c-af4c-0e4198d9d95c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.938878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d74096-85cf-4c7c-af4c-0e4198d9d95c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.939295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d74096-85cf-4c7c-af4c-0e4198d9d95c None admin] PATH_INFO: `/v3/users/6771164d401445d9905e4d1c798611b1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.940850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d74096-85cf-4c7c-af4c-0e4198d9d95c None admin] RBAC: Authorizing `identity:get_user(user_id=6771164d401445d9905e4d1c798611b1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.941573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.942342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d74096-85cf-4c7c-af4c-0e4198d9d95c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.943997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 171/351] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/users/6771164d401445d9905e4d1c798611b1 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:06.945279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06bc29-1e6e-47c3-95b5-340b0ab0a571 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.945567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06bc29-1e6e-47c3-95b5-340b0ab0a571 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.945863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06bc29-1e6e-47c3-95b5-340b0ab0a571 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.947382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 172/352] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:06.948148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06bc29-1e6e-47c3-95b5-340b0ab0a571 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.011246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d687-4deb-4077-a80d-b2ab65a3e5b2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.055488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.057068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.057530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.058201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.059765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.061857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.063854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 181/353] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.064417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.083763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06bc29-1e6e-47c3-95b5-340b0ab0a571 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.127213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.128476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.128978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.129459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.131039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.132790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.138408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 173/354] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.138408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.194797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8bc0-be0a-416c-a2be-fa9df6d8d28c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.213210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:07.213692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:07.238333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c984ad-63b2-4b6e-9f69-f20a7c79cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.239738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c984ad-63b2-4b6e-9f69-f20a7c79cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.240160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c984ad-63b2-4b6e-9f69-f20a7c79cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.240587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c984ad-63b2-4b6e-9f69-f20a7c79cfa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.255295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c984ad-63b2-4b6e-9f69-f20a7c79cfa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-75c984ad-63b2-4b6e-9f69-f20a7c79cfa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:07.263928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:07.264847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:07.265634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 182/355] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:07.268471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.268471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.268471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.272634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66537275-2263-4e07-9303-b5897eae72eb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.285826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:07.287042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:07.316444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.317121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.317406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.317715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.318573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] RBAC: Adding query filter params (role.id=f75fb04d0e774fcf9fc11883ae4eb057, user.id=6771164d401445d9905e4d1c798611b1, scope.system=all) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:07.318892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.320382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.335648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 174/356] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/role_assignments?user.id=6771164d401445d9905e4d1c798611b1&scope.system=all&role.id=f75fb04d0e774fcf9fc11883ae4eb057 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.340265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.381766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 183/357] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:07.382880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.504907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879c9dc-dc9e-4b2b-b097-5c5644f389fc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.530087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:07.535818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab9553-b01c-40a6-a45c-acb7c3034130 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.538244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:07.553234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f080-51ac-4caa-aea9-df57a7d34450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.554176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f080-51ac-4caa-aea9-df57a7d34450 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.554470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f080-51ac-4caa-aea9-df57a7d34450 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.554753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f080-51ac-4caa-aea9-df57a7d34450 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.566131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0f080-51ac-4caa-aea9-df57a7d34450 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.567959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0f080-51ac-4caa-aea9-df57a7d34450 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.570473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 175/358] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.573471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168669-8b70-46b9-936a-dbee512eec83 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.574153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168669-8b70-46b9-936a-dbee512eec83 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.574623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af168669-8b70-46b9-936a-dbee512eec83 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.580332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 176/359] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:07.581533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168669-8b70-46b9-936a-dbee512eec83 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.583353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.584274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.584692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.584855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.586987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.588558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.591255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 184/360] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.592069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.719519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f36f1-7aae-4973-9f59-afb4fd370b37 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.723526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af168669-8b70-46b9-936a-dbee512eec83 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.762496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.763162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e86d5-6fa7-4866-bef9-0b5a6a70a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.763300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.763485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.763754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.763978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e86d5-6fa7-4866-bef9-0b5a6a70a67f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.764259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e86d5-6fa7-4866-bef9-0b5a6a70a67f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.764526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:07.764627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e86d5-6fa7-4866-bef9-0b5a6a70a67f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.764842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.766272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.778246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 177/361] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.778556 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e86d5-6fa7-4866-bef9-0b5a6a70a67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:07.778946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-601e86d5-6fa7-4866-bef9-0b5a6a70a67f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:07.787104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:07.788093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:07.788868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 185/362] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:07.790771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.790771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.790951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.810755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:07.812206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:07.836566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:07.843944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:07.901445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 186/363] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:07.903222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:07.918370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da60081-f79d-4a36-a64a-f566bb670943 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:07.961989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:07.962386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:07.962668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:07.963062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:07.963925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=6e456a52276f4fc6af10bdd5f459c921) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:07.964244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:07.965814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:07.971722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 178/364] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=8206853c3da544e6afa9c839366fd552 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:07.972644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.043030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b4cb9-7b3d-4151-a16e-f89f57bebd21 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.090610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.091663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.092124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.092524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.094014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=6e456a52276f4fc6af10bdd5f459c921) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:08.094676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:08.096441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:08.103568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 187/365] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=74a02bd410af491aba0207712ba4d774 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:08.104677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.134454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1361b6-42c1-42d8-b39c-df776064c250 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.144738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:08.149562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:08.181067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.181907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.182198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.182478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.256431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a47108-ceb5-4128-bdd1-d58819d4feb8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.286451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:08.288036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:08.316833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.317467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.317794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.318078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.318876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:08.319188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:08.320762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:08.339339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 188/366] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:08.340246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.443113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 179/367] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:08.444288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.455159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:08.475291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:08.497150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ad91-25bd-4427-8091-04295fd828b3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.544645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.545479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.546171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.546461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.563414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:08.569125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:08.570350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:08.571136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:08.571804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 189/368] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:08.577712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.577987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef3d6-7c53-40e6-9854-59846a8c9afa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.635454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.636136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.637015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.637015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.720231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff1c8-bb3f-4f61-bc05-faca10d74f5f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.734273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:08.735836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:08.745456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:08.759096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.760392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.760906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.761425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.762997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:08.764732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:08.767039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 190/369] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:08.768155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.806001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:08.858284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 180/370] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:08.859161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.887602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988794c-a004-4f7c-b781-2eb078601a10 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.926065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:08.927240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:08.927799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:08.928270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:08.929294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:08.934051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:08.935948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:08.955804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 191/371] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:08.958427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:08.980894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2d31-3d6c-4de2-81b1-e1a6015ec121 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:08.990127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:09.025540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.027558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.027702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.027970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.029319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.030877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.033088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 181/372] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:09.033940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.090250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:09.122212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e28a-3a6f-4193-aae4-2a8feecde0d9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.171229 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.172132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.172419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.172697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.174921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.176409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.180078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bb284-9901-478e-9527-b5f5bad52bed None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.184789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 192/373] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:08 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:09.185501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.231057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.232113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.232613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.233517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.299173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:09.332934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebbe7d-d432-4b85-9da6-67a6bb35b836 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.336107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.337774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.387642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.389216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.389724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.390644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.392002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=151cf301e614473faba59cc02f1ddb0a) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:09.392505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.394517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.403293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 193/374] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=74a02bd410af491aba0207712ba4d774 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:09.404254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.436217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:09.467403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 182/375] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:09.473768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.606085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:09.656488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72619f-26cc-4cbe-82f9-dc00215e82de None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.662408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c4bd-42c5-4e77-8c4d-9ae0731fd0b9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.724200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.725088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.725375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.725680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] PATH_INFO: `/v3/projects/0d05c319491241dd84abdf976390ca06` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.726835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.727700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.727979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.728254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.729672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0d05c319491241dd84abdf976390ca06)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.731156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.733647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.735103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.737062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 194/376] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:09.737312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 183/377] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/projects/0d05c319491241dd84abdf976390ca06 => generated 344 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:09.739247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.747872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.890156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:09.917127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7cd97-7575-40ce-a183-67aa981f99b9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.930979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62160-8202-40d2-84de-00a6a00a91d4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:09.952372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.953258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.953552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.953868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] PATH_INFO: `/v3/groups/13970f37f98a40d3bde2e7fe161f0166` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.962466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] RBAC: Authorizing `identity:get_group(group_id=13970f37f98a40d3bde2e7fe161f0166)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.964095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:09.966257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 195/378] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/groups/13970f37f98a40d3bde2e7fe161f0166 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:09.972288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:09.995972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:09.996653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:09.996940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:09.997215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:09.998113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=151cf301e614473faba59cc02f1ddb0a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:09.998425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:09.999889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e221b51-425a-4a4b-9dff-8ba372095bb8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:10.015438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 184/379] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=8206853c3da544e6afa9c839366fd552 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:10.086614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a6b7-5562-48fa-ae44-ff622516e54b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:10.126365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:10.127060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:10.127354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:10.127637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:10.128522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] RBAC: Adding query filter params (group.id=13970f37f98a40d3bde2e7fe161f0166, role.id=2702c53281284456a65007036b36070c, scope.project.id=0d05c319491241dd84abdf976390ca06) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:10.128838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:10.130412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ff27b-0bca-4d55-8417-0815055eef97 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:10.137732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 196/380] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:09 2022] GET /identity/v3/role_assignments?group.id=13970f37f98a40d3bde2e7fe161f0166&scope.project.id=0d05c319491241dd84abdf976390ca06&role.id=2702c53281284456a65007036b36070c => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:10.519310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6911eb-7753-4101-beb8-5d447a7beaca None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:10.519838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6911eb-7753-4101-beb8-5d447a7beaca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:10.519838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6911eb-7753-4101-beb8-5d447a7beaca None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:10.521698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 185/381] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:10.528494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2515f0b-def0-4a85-a2cd-cbc145139aef None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:10.528901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2515f0b-def0-4a85-a2cd-cbc145139aef None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:10.529047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2515f0b-def0-4a85-a2cd-cbc145139aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:10.539208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:10.555044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f2515f0b-def0-4a85-a2cd-cbc145139aef None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:10.556246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f2515f0b-def0-4a85-a2cd-cbc145139aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:10.662609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444962e-a01e-4faa-8011-ed0e44fecb59 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:10.663055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444962e-a01e-4faa-8011-ed0e44fecb59 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:10.663184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444962e-a01e-4faa-8011-ed0e44fecb59 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:10.665137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 197/383] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:10.666155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 186/383] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:10.692208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444962e-a01e-4faa-8011-ed0e44fecb59 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:10.692758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:10.693062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:10.693350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:10.703825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:10.722699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:10.723918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:10.857852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 198/384] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:10.870476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444962e-a01e-4faa-8011-ed0e44fecb59 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:10.909073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:10.929564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:10.930953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:10.931363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:10.931762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:10.953280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:10.962351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:10.963295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:10.964058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:10.966463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 187/385] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:10.978345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.020727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.082582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.121226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1fc6-8f1d-435f-8b08-2611a924688d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.127538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f43a-b187-4d4e-83e1-d800aaaf6948 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.157805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.158491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.158836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.159123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.159895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:11.160209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.161806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.172235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 188/386] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:11.177612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.219596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.220768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.221261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.221828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.254185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:11.269622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:11.270546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:11.271310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:11.273917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 199/387] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:11.280104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.289505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da9f5-3e6b-45e2-bd26-e304ff92aea0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.333980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.349792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.350681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.350960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.351239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.355949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.357443 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.366633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 189/388] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:11 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:11.372089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.503295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fa13a-d16f-4a36-a333-b0539235e50d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.538473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb73795-5c6e-499e-8257-73e4aaec9272 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.576489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.577379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.577715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.577999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.579228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.580691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.583209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 190/389] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:11 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:11.592065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.601981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.625956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.626567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.626853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.627134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.627907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:11.628220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.629627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.655171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 200/390] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:11.660106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.746908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.764255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225589-5f49-465c-9335-44ef5e1126ea None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.798343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.799230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.799515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.799795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.800996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.802538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.804304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 201/391] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:11 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:11.809915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.867771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.895707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68400172-45ba-4be7-9371-4873153ea113 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.913705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fba78-7a64-400f-ad31-de69d07526fa None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.957355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547a7b-0d83-4d88-bb62-b5df3a570751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.959038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547a7b-0d83-4d88-bb62-b5df3a570751 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.959512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547a7b-0d83-4d88-bb62-b5df3a570751 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.959930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547a7b-0d83-4d88-bb62-b5df3a570751 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.961901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19547a7b-0d83-4d88-bb62-b5df3a570751 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.964445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19547a7b-0d83-4d88-bb62-b5df3a570751 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.967675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 202/392] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:11 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:11.969289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71b14-2c4e-433b-92a4-81e1bf393b6e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.969845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71b14-2c4e-433b-92a4-81e1bf393b6e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.970277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71b14-2c4e-433b-92a4-81e1bf393b6e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.976183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 203/393] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:11.977535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71b14-2c4e-433b-92a4-81e1bf393b6e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.981553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565a3c-0989-43c5-bc92-eaf76d6f1c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.983485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565a3c-0989-43c5-bc92-eaf76d6f1c3c None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.983775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565a3c-0989-43c5-bc92-eaf76d6f1c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.984059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565a3c-0989-43c5-bc92-eaf76d6f1c3c None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.986236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565a3c-0989-43c5-bc92-eaf76d6f1c3c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e456a52276f4fc6af10bdd5f459c921, group_id=b54d8d347bc747e5801cbf6f43da1b29, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.987695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565a3c-0989-43c5-bc92-eaf76d6f1c3c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:12.013627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 191/394] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 23 11:43:11 2022] PUT /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:12.013627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.013627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.013627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.062551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:12.064075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:12.183190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71b14-2c4e-433b-92a4-81e1bf393b6e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:12.210777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 192/395] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:12.222579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:12.236476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:12.237671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.238093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.238553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.241448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] RBAC: Authorizing `identity:create_grant(project_id=6e456a52276f4fc6af10bdd5f459c921, group_id=b54d8d347bc747e5801cbf6f43da1b29, role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:12.242187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:12.243361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:12.267652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 204/396] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 23 11:43:11 2022] PUT /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/8206853c3da544e6afa9c839366fd552 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:12.315416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:12.367649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a5ac1-1f9e-48f1-8cea-1a83454395dc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:12.410820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495c09d-3068-4b2d-8876-fafaa8c091ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:12.411646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495c09d-3068-4b2d-8876-fafaa8c091ff None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.411928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495c09d-3068-4b2d-8876-fafaa8c091ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.412201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495c09d-3068-4b2d-8876-fafaa8c091ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.424091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495c09d-3068-4b2d-8876-fafaa8c091ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c495c09d-3068-4b2d-8876-fafaa8c091ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:12.432126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:12.433066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:12.434404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 193/397] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:12.440028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:12.557970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e6f5-4596-4619-b3dc-cd1bb4f37bca None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:12.595505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:12.596477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.596788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547036-48a3-4f1c-a60f-88aec3da7e7f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.597215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547036-48a3-4f1c-a60f-88aec3da7e7f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.597351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547036-48a3-4f1c-a60f-88aec3da7e7f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.597721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.598164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.599027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 194/398] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:12.599312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:12.599783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:12.601419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:12.607538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767d0d2-b4e4-4693-823f-118acf4d2490 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.608142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767d0d2-b4e4-4693-823f-118acf4d2490 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.608614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767d0d2-b4e4-4693-823f-118acf4d2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.611781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 205/399] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:12.618412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:12.630215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0767d0d2-b4e4-4693-823f-118acf4d2490 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:12.631808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0767d0d2-b4e4-4693-823f-118acf4d2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:12.668844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:12.725188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 195/400] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:12.725188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479711d-49dd-4969-ade4-eec8036b768b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.725188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479711d-49dd-4969-ade4-eec8036b768b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.725188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479711d-49dd-4969-ade4-eec8036b768b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.726298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 196/401] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:12.730751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.731045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.731330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.747076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e23821-d9d9-4844-8a53-4bf6145e8320 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:12.755092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:12.756653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:12.786052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:12.788276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:12.789023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:12.789500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:12.792160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:12.794801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:12.797873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 206/402] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:12 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:12.798986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:12.809005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:12.849621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 197/403] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:12.849621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:12.950894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07bb2-49da-416f-98f1-3394332d00c3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:12.968919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:12.989217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d608f8-7aad-41ae-a5d5-6ca5eef8c399 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.005258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.005951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.006240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.006525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.017853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:13.026142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:13.027287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 207/404] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:13.033590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.051035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.052511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.053412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.054075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.055973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.058285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.061193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 198/405] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:12 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:13.062544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.120968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:13.162306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce60e-3cd5-4274-8d69-72ef4dec629f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.183652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08447423-3292-4507-9a0e-b0b4e7b4bb81 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.208065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.209359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.210242 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.210668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.221383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.222216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.222600 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.222977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.223843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:13.224263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.225270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:13.225902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.234963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 199/406] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:13.235826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:13.236917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:13.237925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:13.238667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.246116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 208/407] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:13.246116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.290062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:13.375024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6eeeb-313c-4ac1-b04e-34ff317cb6a2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.378573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:13.381987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c876d-e8b6-4acd-a110-c6247f78c128 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.419898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.420770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.421055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.421339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.422069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.422552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.423382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.423850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.424023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.424471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.425881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 209/408] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:13.426464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.427330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] RBAC: Authorizing `identity:create_grant(project_id=151cf301e614473faba59cc02f1ddb0a, group_id=b54d8d347bc747e5801cbf6f43da1b29, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.429081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.447967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 200/409] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 23 11:43:13 2022] PUT /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:13.449420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.599965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:13.608864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809a8a8-5613-42b3-abea-e619dc3fba23 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.655765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99c340-2890-4edb-aed5-0eae92948460 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.670309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.671305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.671755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.672207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.673150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:13.673646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.675239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.689789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 210/410] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:13.691925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.700265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.701166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.701457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.701767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.703095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.704458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.708174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 201/411] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:13.712884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.754103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:13.862520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1659-ce48-4379-bbc8-dce46f56a6a7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.890874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9e40d-7b6c-46ab-920c-3752ced89844 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:13.917681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.918930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.919403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.919885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] PATH_INFO: `/v3/groups/13970f37f98a40d3bde2e7fe161f0166` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.921247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] RBAC: Authorizing `identity:get_group(group_id=13970f37f98a40d3bde2e7fe161f0166)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.922907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.929385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 211/412] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/groups/13970f37f98a40d3bde2e7fe161f0166 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:13.930903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:13.938704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:13.941966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:13.944123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:13.944633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:13.952733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] RBAC: Authorizing `identity:create_grant(project_id=151cf301e614473faba59cc02f1ddb0a, group_id=b54d8d347bc747e5801cbf6f43da1b29, role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:13.954499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:13.977343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 202/413] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 23 11:43:13 2022] PUT /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a/groups/b54d8d347bc747e5801cbf6f43da1b29/roles/8206853c3da544e6afa9c839366fd552 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:43:14.010036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:14.129582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9f2c-fe93-4b82-b774-cef8820ef738 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:14.170497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56533e6a-0216-4651-bbe0-039be4d93938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:14.171820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56533e6a-0216-4651-bbe0-039be4d93938 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.172239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56533e6a-0216-4651-bbe0-039be4d93938 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.172655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56533e6a-0216-4651-bbe0-039be4d93938 None admin] PATH_INFO: `/v3/projects/0d05c319491241dd84abdf976390ca06` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.174608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56533e6a-0216-4651-bbe0-039be4d93938 None admin] RBAC: Authorizing `identity:get_project(project_id=0d05c319491241dd84abdf976390ca06)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:14.176892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56533e6a-0216-4651-bbe0-039be4d93938 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:14.179947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 212/414] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:13 2022] GET /identity/v3/projects/0d05c319491241dd84abdf976390ca06 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:14.185773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:14.340181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:14.352546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01944346-6f1b-436b-96a1-0a62ec58a24e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:14.414430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da362ca-4084-4416-8895-62d9aa8c5fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:14.415568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da362ca-4084-4416-8895-62d9aa8c5fb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.416077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da362ca-4084-4416-8895-62d9aa8c5fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.416491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da362ca-4084-4416-8895-62d9aa8c5fb8 None admin] PATH_INFO: `/v3/projects/0d05c319491241dd84abdf976390ca06/groups/13970f37f98a40d3bde2e7fe161f0166/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.418775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da362ca-4084-4416-8895-62d9aa8c5fb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d05c319491241dd84abdf976390ca06, group_id=13970f37f98a40d3bde2e7fe161f0166, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:14.420398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da362ca-4084-4416-8895-62d9aa8c5fb8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:14.440066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 203/415] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Jun 23 11:43:14 2022] PUT /identity/v3/projects/0d05c319491241dd84abdf976390ca06/groups/13970f37f98a40d3bde2e7fe161f0166/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:14.487294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516019a-6649-4895-9655-92b139a3fca6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.487747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516019a-6649-4895-9655-92b139a3fca6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.488130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516019a-6649-4895-9655-92b139a3fca6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.490144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 213/416] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:14.496640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82a48-d514-4de3-bcc4-6f663ed315bb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.497170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82a48-d514-4de3-bcc4-6f663ed315bb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.497645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82a48-d514-4de3-bcc4-6f663ed315bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.527123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9ad82a48-d514-4de3-bcc4-6f663ed315bb None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:14.528601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9ad82a48-d514-4de3-bcc4-6f663ed315bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:14.625755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 204/417] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:14.643350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516019a-6649-4895-9655-92b139a3fca6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:14.774730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:14.779433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516019a-6649-4895-9655-92b139a3fca6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:14.814603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:14.815509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.815798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.816075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.824184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9953-cd91-4a0c-aec7-919ee0b1dab1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.824694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9953-cd91-4a0c-aec7-919ee0b1dab1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.824794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9953-cd91-4a0c-aec7-919ee0b1dab1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.829638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 205/418] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:14.832167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:14.832459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:14.832735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:14.836011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:14.844317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:14.845206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:14.846005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:14.848389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 214/419] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:14.854765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:14.863826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:14.865510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:15.007649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 206/420] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:15.030913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483e05-4759-4f65-8622-92eb0a8aef63 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:15.049745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.070269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:15.070918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:15.071199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:15.071471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:15.072267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:15.072613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:15.074427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:15.079480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:15.088957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 215/421] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:15.090434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.118048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:15.201984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3573d5-b8cd-4909-9bf4-69806a895991 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:15.238052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:15.238865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:15.239239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:15.240065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:15.318042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:15.318042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:15.335165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:15.371728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3ca9c-17f5-4f73-88c6-365aa82bbf5d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:15.425489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 216/422] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:43:15.426831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.441096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:15.442281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:15.442773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:15.443275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:15.455129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:15.464500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:15.465442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:15.466250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:15.468946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 207/423] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:15.486788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.536899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ce955-85d6-43ad-bd52-e33bf7e78e29 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:15.570083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:15.573825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:15.575047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:15.575525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:15.575970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:15.577754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:15.579302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:15.586070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 217/424] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:15.587505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.685986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:15.703838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82f3f1-77ad-4b9b-aef9-ca24c8a5e4b2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:15.743704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:15.745068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:15.745068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:15.745273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:15.749623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:15.749623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:15.754189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 218/425] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:15.756759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.767868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3837-d735-4a23-8b55-257aa08e0f50 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:15.833768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:15.834387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:15.834654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:15.834943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:15.835376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:15.835722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:15.836064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:15.837472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:15.854428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 208/426] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:15.861125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:15.943161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18ffe3-e925-4ec0-ab7a-8001705fbf6b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.011452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.012370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.012799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.013218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.014265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=6e456a52276f4fc6af10bdd5f459c921) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:16.014832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:16.017221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a942c2-892a-4bef-b411-dd646039a224 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:16.029579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 219/427] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=74a02bd410af491aba0207712ba4d774 => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:16.031672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e90c6-461d-461c-b3e6-21e97fd166ce None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.077044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.078010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.078467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.078888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.082006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:16.160864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:16.162639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:16.218110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d951a-9606-4a09-8d0c-4ba77b57c8c8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.219280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d951a-9606-4a09-8d0c-4ba77b57c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.220074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d951a-9606-4a09-8d0c-4ba77b57c8c8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.223225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 220/428] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:16.233534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.233860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.234136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.274781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:16.276052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:16.285316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 209/429] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:43:16.295500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:16.333705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:16.377078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 221/430] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:16.412860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:16.415685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f607f-7e9f-414d-8c00-672dd5f3b40c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.461630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.462937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.463461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.464027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] PATH_INFO: `/v3/projects/6e456a52276f4fc6af10bdd5f459c921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.465814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] RBAC: Authorizing `identity:get_project(project_id=6e456a52276f4fc6af10bdd5f459c921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:16.468677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:16.477815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 210/431] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/projects/6e456a52276f4fc6af10bdd5f459c921 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:16.481896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:16.490436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:16.573832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf058-ac97-4748-a62e-0d618dc537b9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.625542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d896748-17ad-45b5-9b60-5e8376a7fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.626740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896748-17ad-45b5-9b60-5e8376a7fb6b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.626966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896748-17ad-45b5-9b60-5e8376a7fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.627244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896748-17ad-45b5-9b60-5e8376a7fb6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.633557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289caf-e5ad-4c0e-9110-ef157676ba2a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.634260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:16.641834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d896748-17ad-45b5-9b60-5e8376a7fb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1d896748-17ad-45b5-9b60-5e8376a7fb6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:16.652243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:16.653454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:43:16.654253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:16.658879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 222/432] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:16.658879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d3f2-9381-4de5-b0d8-fb47fdb2f364 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.658879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d3f2-9381-4de5-b0d8-fb47fdb2f364 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.658879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d3f2-9381-4de5-b0d8-fb47fdb2f364 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.662927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 223/433] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:16.665641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d3f2-9381-4de5-b0d8-fb47fdb2f364 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:16.689146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b38f9-8220-420f-a07e-fa7d6b2d2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.690073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b38f9-8220-420f-a07e-fa7d6b2d2229 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.690354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b38f9-8220-420f-a07e-fa7d6b2d2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.690630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b38f9-8220-420f-a07e-fa7d6b2d2229 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.692531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b38f9-8220-420f-a07e-fa7d6b2d2229 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:16.694856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b38f9-8220-420f-a07e-fa7d6b2d2229 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:16.700872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 211/434] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:16.702385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.702679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.702937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.725397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:16.727002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:16.810249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 212/435] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:16.811407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:16.832708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62d3f2-9381-4de5-b0d8-fb47fdb2f364 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.845286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:16.876122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.876811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.877100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.877376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.878182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:16.878495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:16.879915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:16.897428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 224/436] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:16.897428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:16.942318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:16.946253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11085d-ec80-469f-ab36-3110018dfa53 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:16.983452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:16.984119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:16.984388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:16.984659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:16.985504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=6e456a52276f4fc6af10bdd5f459c921) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:16.985929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:16.987430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:16.995695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 213/437] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=6e456a52276f4fc6af10bdd5f459c921&role.id=8206853c3da544e6afa9c839366fd552 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:17.003150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.027135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5dcf-f345-4b6e-b8a3-a6634c2d9a25 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.072723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4b36-6c9a-4814-b1c0-bedf443dbd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.073563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4b36-6c9a-4814-b1c0-bedf443dbd1f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.073863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4b36-6c9a-4814-b1c0-bedf443dbd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.074143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4b36-6c9a-4814-b1c0-bedf443dbd1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.087260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc4b36-6c9a-4814-b1c0-bedf443dbd1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d4fc4b36-6c9a-4814-b1c0-bedf443dbd1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:17.095750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:17.096734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:17.097506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 225/438] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:17.098544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc536c-29d0-43b8-b234-91a4aa9bece5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.098710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc536c-29d0-43b8-b234-91a4aa9bece5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.098993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc536c-29d0-43b8-b234-91a4aa9bece5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.100677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 226/439] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:17.104997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc536c-29d0-43b8-b234-91a4aa9bece5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.148626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52050dbd-3b80-4ec6-bb83-53f3875fda37 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.159303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.192068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.192811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.193035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.193314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.236299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.258267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc536c-29d0-43b8-b234-91a4aa9bece5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.298318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:17.300195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:17.303206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.303900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.304207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.304454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.305226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:17.305533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:17.307171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2202da-86ea-48d3-a25b-f7cd45b38e30 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:17.320269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 227/440] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:17.321520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.321938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.322266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.342986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:17.344216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:17.426544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 228/441] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:17.427462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.450841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 214/442] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:17.451675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.468743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.523120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.555199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81210-1253-4d48-9e03-d32481bfde65 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.563588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b399e-7100-4103-89a6-88ea8968362b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.593727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.594390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.594674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.594951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.596826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.597622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.597936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.598205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.611982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:17.620378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:17.621459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:17.622277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 215/443] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:17.622899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.675234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:17.676718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:17.700807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.724676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da6357-bc25-4006-8786-aa6e8c534785 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.750247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.764293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.766153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.766697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.767195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.769205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:17.770752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:17.772487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 216/444] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:17.773258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.780745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 229/445] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:17.781590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.884095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e5fa-82cb-471f-a6f0-34bfdcc42f95 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.890046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48327183-e3a1-4dd8-aef0-d8977945856f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:17.913975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:17.921280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.921988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.922274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.922555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.923322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:17.923636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:17.924766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:17.925032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:17.925651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:17.925936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:17.926207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:17.927372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:17.928808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:17.930473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 230/446] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:17.931221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.941195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 217/447] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:17.941195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:17.998177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:18.034336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb7e4f-aa67-4c78-a821-a550a6f7e714 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.046619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab75b6-3b05-41a0-8793-4e59434da3fb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.073153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.074058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.074336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.074580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] PATH_INFO: `/v3/projects/151cf301e614473faba59cc02f1ddb0a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.075844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] RBAC: Authorizing `identity:get_project(project_id=151cf301e614473faba59cc02f1ddb0a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.077318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.079077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 231/448] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/projects/151cf301e614473faba59cc02f1ddb0a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:18.079839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:18.087836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.088558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.088931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.089182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.090076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=74a02bd410af491aba0207712ba4d774, scope.project.id=151cf301e614473faba59cc02f1ddb0a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:18.090391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.091855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.098395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 218/449] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:17 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=74a02bd410af491aba0207712ba4d774 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:18.099121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:18.155914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:18.203427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8840946-2eff-4f12-8cc1-6e13c6970912 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.212999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400032a3-136b-4e32-9f47-ac0a0d0ef7c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.233210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:18.246483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.247231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.247509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.247780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.254085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.254932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.255275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.255554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] PATH_INFO: `/v3/groups/b54d8d347bc747e5801cbf6f43da1b29` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.256787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] RBAC: Authorizing `identity:get_group(group_id=b54d8d347bc747e5801cbf6f43da1b29)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.258310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.260077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 219/450] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:18 2022] GET /identity/v3/groups/b54d8d347bc747e5801cbf6f43da1b29 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:18.266822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:18.332455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.333957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.391709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab203d8-12fa-485d-ae47-59eb4ea8ee86 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.408542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:18.435885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.436593 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.436883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.437158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.438301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] RBAC: Adding query filter params (group.id=b54d8d347bc747e5801cbf6f43da1b29, role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=151cf301e614473faba59cc02f1ddb0a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:18.438405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.439815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.449460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 220/451] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:18 2022] GET /identity/v3/role_assignments?group.id=b54d8d347bc747e5801cbf6f43da1b29&scope.project.id=151cf301e614473faba59cc02f1ddb0a&role.id=8206853c3da544e6afa9c839366fd552 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:18.466871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 232/452] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:18.472607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:18.536408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:18.593391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79a29-3572-4481-9ec8-d888e12674b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.630122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.631011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.631405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.631813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] PATH_INFO: `/v3/projects/0d05c319491241dd84abdf976390ca06` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.633815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] RBAC: Authorizing `identity:get_project(project_id=0d05c319491241dd84abdf976390ca06)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.636304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.638297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 221/453] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:43:18 2022] GET /identity/v3/projects/0d05c319491241dd84abdf976390ca06 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:18.645744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:18.753105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3442d-780a-422e-be79-08af71d0ab32 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.788483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a500-d860-48d2-a146-5a6cae1915ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.789282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a500-d860-48d2-a146-5a6cae1915ae None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.789563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a500-d860-48d2-a146-5a6cae1915ae None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.789870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a500-d860-48d2-a146-5a6cae1915ae None admin] PATH_INFO: `/v3/groups/13970f37f98a40d3bde2e7fe161f0166` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.791106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a500-d860-48d2-a146-5a6cae1915ae None admin] RBAC: Authorizing `identity:get_group(group_id=13970f37f98a40d3bde2e7fe161f0166)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.792569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a500-d860-48d2-a146-5a6cae1915ae None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.794282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 233/454] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Jun 23 11:43:18 2022] GET /identity/v3/groups/13970f37f98a40d3bde2e7fe161f0166 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:18.800205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:18.912677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166aa5-508f-419a-b900-21beb9ec2f47 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:18.930271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:18.948826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:18.949480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:18.949795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:18.950072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:18.950903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] RBAC: Adding query filter params (group.id=13970f37f98a40d3bde2e7fe161f0166, role.id=2702c53281284456a65007036b36070c, scope.project.id=0d05c319491241dd84abdf976390ca06) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:18.951220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:18.952651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ad3f7-3135-4ba4-965d-f56e162aa430 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:18.958623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 222/455] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Jun 23 11:43:18 2022] GET /identity/v3/role_assignments?group.id=13970f37f98a40d3bde2e7fe161f0166&scope.project.id=0d05c319491241dd84abdf976390ca06&role.id=2702c53281284456a65007036b36070c => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:21.578610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305bb6-2968-45ca-a163-dd5a063a4289 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.579648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305bb6-2968-45ca-a163-dd5a063a4289 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.580122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305bb6-2968-45ca-a163-dd5a063a4289 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.581992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 234/456] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:21.587003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17d46-7a3a-4f91-a824-6ccc22fc18cc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.587415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17d46-7a3a-4f91-a824-6ccc22fc18cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.587653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d17d46-7a3a-4f91-a824-6ccc22fc18cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.610630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f6d17d46-7a3a-4f91-a824-6ccc22fc18cc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:21.611855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6d17d46-7a3a-4f91-a824-6ccc22fc18cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:21.708253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 223/457] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:21.745375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305bb6-2968-45ca-a163-dd5a063a4289 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:21.781846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:21.782430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802bd7b-2640-4b62-b56d-c505582f401b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.782726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802bd7b-2640-4b62-b56d-c505582f401b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.783290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802bd7b-2640-4b62-b56d-c505582f401b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.785397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 224/458] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:21.791405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a518-3b4c-41b6-871b-8658822a32a4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.791685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a518-3b4c-41b6-871b-8658822a32a4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.791969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a518-3b4c-41b6-871b-8658822a32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.818721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9002a518-3b4c-41b6-871b-8658822a32a4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:21.822823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9002a518-3b4c-41b6-871b-8658822a32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:21.882576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305bb6-2968-45ca-a163-dd5a063a4289 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:21.905730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 225/459] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:21.907226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3abc4b-326a-4b2c-9223-432321c09d54 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.907518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3abc4b-326a-4b2c-9223-432321c09d54 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.907802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3abc4b-326a-4b2c-9223-432321c09d54 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.909446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 226/460] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:21.914794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.915080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.915363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.934231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:21.935525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:21.936126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:21.937163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:21.937772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:21.938259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:21.949973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:21.951987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:21.972422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:21.973361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:21.974209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:21.974209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:21.974209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:21.974209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:21.975165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:21.976989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 235/461] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:21.978037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.007890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 227/462] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:22.008783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.075570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:22.098774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18b8d-2d2b-4d7a-9676-d4248130fd46 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.113477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bc00a-9a4a-488f-8f75-6316d0ea574a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.137479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.138414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.138836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.139182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.149337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.150126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.150421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.150699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.150885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.151541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:22.151912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.152566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.153296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.165340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 228/463] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:22.166795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:22.176084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:22.176926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:22.177768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:22.177768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:22.177768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:22.177768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:22.179171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 236/464] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:22.179337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.209648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:22.286407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171eaf-6118-4a37-9500-b48ba82cabf8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.286744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595d12-5b80-4a8d-91de-ff4fd1cdb2ba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.317308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:22.324144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.324843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.325012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.325308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.325679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.325823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.325951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.326230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.326659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.328396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.338311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.340050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.357968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 237/465] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:43:22 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:22.359340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:22.360674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:22.361463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:22.362347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:22.362347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:22.362347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:22.362347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:22.362551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 229/466] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:22.368105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.468142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:22.486767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bd2c-3e57-445e-84b5-d3807d2f4dfd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.513315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecc604-3e09-47ba-817b-039ca4a0ef5c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.529719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.531125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.531707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.532067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.532896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:22.533214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.534716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9806ed-e2f0-4130-9c82-51297b2b79f4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.551054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 230/467] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:22.553632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002de53-9616-484b-9e5f-96f497b694c9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.553632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002de53-9616-484b-9e5f-96f497b694c9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.553632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002de53-9616-484b-9e5f-96f497b694c9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.554680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 231/468] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:22.561047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002de53-9616-484b-9e5f-96f497b694c9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.580237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.581093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.581384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.581693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.582453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:22.582771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.584213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca0c3b-10ae-450c-959a-e25106969f59 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.605288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 238/469] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:22.607003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.607295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.607576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.626869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:22.628095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:22.678764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:22.703395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002de53-9616-484b-9e5f-96f497b694c9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.708942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 239/470] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:22.709850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.761027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.762020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.763235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.763533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.764276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.765803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.789128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:22.796938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 232/471] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:43:22 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:22.798005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:22.895642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a77db-37a5-40a3-b498-64ce6d879457 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:22.968259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b794f0-0db4-4586-b5a4-56d521356f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:22.968960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b794f0-0db4-4586-b5a4-56d521356f29 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:22.969243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b794f0-0db4-4586-b5a4-56d521356f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:22.969524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b794f0-0db4-4586-b5a4-56d521356f29 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:22.970292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b794f0-0db4-4586-b5a4-56d521356f29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:22.973318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b794f0-0db4-4586-b5a4-56d521356f29 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:22.979285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7704bf-26df-4680-bb88-38d1ec2309ed None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:23.010832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 240/472] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:43:22 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:23.046407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:23.048406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3949aa-9999-4d7a-8c2f-378241040e4a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.048690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3949aa-9999-4d7a-8c2f-378241040e4a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.048965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3949aa-9999-4d7a-8c2f-378241040e4a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.050788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 241/473] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:23.051174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.051465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.051747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.059024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.059344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.059590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.081224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:23.082836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:23.086977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:23.088679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:23.104223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:23.105169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:23.106497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:23.106497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:23.106497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:23.106497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:23.106497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 233/474] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:23.117638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:23.135527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:23.184042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:23.201332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 242/475] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:23.236178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:23.256705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e20c6-2334-4168-8f45-fdbfc3c2365e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:23.296498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:23.297128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.297417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.297733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.298488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:23.298800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:23.300234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:23.316913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 234/476] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:23.325954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:23.384216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5273f-0c77-41d6-99e1-2f561624683d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:23.456687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:23.463891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.469633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.469762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc65cd-32b5-4dd2-8266-20d86f9702f1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:23.470301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.471402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:23.473141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:23.481763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:23.491739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.sql.core [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 11:43:23.491739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 11:43:23.491739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [parameters: {'id': '1adfd48083a744bca04855eedbf7ab29', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 11:43:23.491739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80159) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 11:43:23.507451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:23.508303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.508595 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.508880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.510191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:23.511893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result.read() Jun 23 11:43:23.518606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:43:23.519482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application yield resource Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise self.value Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application session.commit() Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 11:43:23.520828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.session.flush() Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application compat.raise_( Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 11:43:23.521709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:43:23.522586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result.read() Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:43:23.524343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [parameters: {'id': '1adfd48083a744bca04855eedbf7ab29', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:23.525656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 11:43:23.526750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:23.527696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 243/477] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 23 11:43:23 2022] POST /identity/v3/roles => generated 144 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:23.533987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:23.536299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 235/478] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:43:23 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:43:23.611307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:23.724982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e336-4b20-4595-bd13-a2cd041db406 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:23.770204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cabf7-3986-4015-8b29-8b1f52c976bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:23.771024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cabf7-3986-4015-8b29-8b1f52c976bb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.771302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cabf7-3986-4015-8b29-8b1f52c976bb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.771575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cabf7-3986-4015-8b29-8b1f52c976bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.783427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cabf7-3986-4015-8b29-8b1f52c976bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5b5cabf7-3986-4015-8b29-8b1f52c976bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:23.791778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:23.792685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:23.793633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 244/479] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:23.800345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:23.915110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eb905-eea2-4c34-8921-af81b7d9bdda None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:23.951160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:23.951851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:23.952140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:23.952416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:23.953185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:23.953583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:23.955081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63550c52-3306-4ae8-a582-3655b2c1fa51 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:23.969783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 236/480] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:24.867361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afa17-8093-4789-8aa2-d7867f79c861 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:24.867873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afa17-8093-4789-8aa2-d7867f79c861 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:24.867873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afa17-8093-4789-8aa2-d7867f79c861 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:24.869243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 245/481] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:24.875416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:24.875878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:24.875950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:24.897202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:24.898427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:24.927552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:24.987606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 237/482] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:25.032188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afa17-8093-4789-8aa2-d7867f79c861 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:25.140903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:25.157367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afa17-8093-4789-8aa2-d7867f79c861 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:25.203232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:25.204050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.204336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.204610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.218696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:25.226485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:25.227367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:25.228200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 246/483] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:25.239118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:25.378420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ed062-8e85-418f-9f8b-069d53c72d8a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:25.427476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:25.428490 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.428969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.429439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.430437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:25.430941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:25.432792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff056f3-6c13-43bf-b24e-ce9c086f6db8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:25.443732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 238/484] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:25.449750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:25.577356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520fb4-836c-48de-a7d1-e5a42ea4f209 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.578041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520fb4-836c-48de-a7d1-e5a42ea4f209 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.578530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520fb4-836c-48de-a7d1-e5a42ea4f209 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.580116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 239/485] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:25.585337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.585640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.585930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.591638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d53995-cebd-4921-a1cc-3b1da5b46d73 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:25.615099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:25.616288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:25.652515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:25.662370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:25.663184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.663462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.663735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.691477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:25.692899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:25.707378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:25.721041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:25.721970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:25.722787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:25.722787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:25.722787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:25.722787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:25.731602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 247/486] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:25.732525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:25.743443 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 240/487] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:25.791269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:25.839523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184d246-bc2b-4dbc-b366-450c8e293963 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:25.877035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:25.877818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.878127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.878356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.879087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:25.879396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:25.880874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f05f-9dc6-47e4-a0b1-ed9939030450 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:25.894586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 248/488] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:25.896026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d58e4-2723-4964-9c06-59da5145c072 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.896315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d58e4-2723-4964-9c06-59da5145c072 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.896685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d58e4-2723-4964-9c06-59da5145c072 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.898218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 249/489] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:25.903661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.904593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.904593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.909520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ccd64-3162-4a67-bf2c-d0ab6bd3abdd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:25.925979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:25.927453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:25.959654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:25.960375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:25.960653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:25.960921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:25.975481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:25.985507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:25.986535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:25.987299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:25.990369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 241/490] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:25.991668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.013886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 250/491] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:26.013886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.013886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.017167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.125091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236446e-d181-495d-b4ba-f3e68093d530 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.157574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecbeec-7d55-4dcd-b25e-665b9a1484ca None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.163411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.164229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.164518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.164786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.173621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.175110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:26.191786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:26.192728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:26.193586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:26.197955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 242/492] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:43:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:26.198984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.205113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.206163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.206646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.207118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.208080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:26.208624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.210828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.223567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 251/493] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:26.225124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.278814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.296972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.311189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f256-bf08-49b7-882d-809518dc6582 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.346416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6348b1-66d3-40c2-a2f4-59947a5427b4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.349966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.350772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.351054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.351328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.363057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:26.371267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:26.372143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:26.372896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:26.374425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 243/494] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:26.374847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.389471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.390414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.390846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.391122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.392126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:26.392304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.393764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab8096-f52f-452a-b22d-63e8ab4b82f0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.435512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 252/495] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:26.435512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeeaf-2fcd-4b01-abdd-d857eafd1edd None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.435512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeeaf-2fcd-4b01-abdd-d857eafd1edd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.435512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeeaf-2fcd-4b01-abdd-d857eafd1edd None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.435512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 253/496] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:26.435512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daeeaf-2fcd-4b01-abdd-d857eafd1edd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.494428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fdcd0-6abc-48c5-8e3c-a35f47f89848 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.528165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.534902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.535718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.536007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.536286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.548143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.549671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.557893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daeeaf-2fcd-4b01-abdd-d857eafd1edd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.569580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:26.570155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:26.570960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:26.571801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:26.571801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:26.571801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:26.571801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:26.572431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 244/497] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:26.572971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.603243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.604748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.605418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.605418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.606101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:26.606413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.607833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10b940-c343-46db-9a3b-074c67928f13 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.617464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 254/498] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:26.618820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.619190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.619478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.637058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:26.638297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:26.696800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab284fb-01ce-426c-ad12-5b0de0d8889f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.713724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 255/499] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:26.714698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.734120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd1d23-118e-4fd2-8e82-998fe7bedc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.734776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd1d23-118e-4fd2-8e82-998fe7bedc7c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.735057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd1d23-118e-4fd2-8e82-998fe7bedc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.735332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd1d23-118e-4fd2-8e82-998fe7bedc7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.787524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.803522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd1d23-118e-4fd2-8e82-998fe7bedc7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.805044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd1d23-118e-4fd2-8e82-998fe7bedc7c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.814404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219e9b-3f04-4fd9-9b06-d8736dd2c496 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:26.815924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:26.850704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:26.851367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.857764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.858081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.858901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:26.859208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:26.860647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:26.875004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 256/500] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:26.875866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.917370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 245/501] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:26.918905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15de82-7617-435d-8b33-e8723c602076 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:26.919194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15de82-7617-435d-8b33-e8723c602076 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:26.919473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15de82-7617-435d-8b33-e8723c602076 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:26.921924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 246/502] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:26.921924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15de82-7617-435d-8b33-e8723c602076 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:26.979911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475b87d-c360-4980-ac90-bb61e0f77e02 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.012658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.017315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.018156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.018443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.018714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.029209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15de82-7617-435d-8b33-e8723c602076 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.032427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.033949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:27.051353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.052206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.053030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:27.053030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:27.053030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.053030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:27.053030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 257/503] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.053775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.069553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.070396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.070629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.070745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.070942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.082340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:27.090847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.091736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:27.092501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 247/504] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.093155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.157789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a589e-b18a-4769-8dcb-c224d1a860e9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.191900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.192742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.193012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.193285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.196264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c220-74c8-4840-9aaf-40cc969dde40 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.201021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.202501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4a0fb2c5-2bd1-4f0d-a2ac-531a8814b856 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:27.217696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.218714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:27.219583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 258/505] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.220237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.220502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.220775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.237836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:27.238963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.239113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:27.240127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.240418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.240682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.255548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.257043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.259800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:27.275477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.276387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.277211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:27.277211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:27.277211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.277211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:27.277211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 248/506] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.277926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.314652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 259/507] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:27.315742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.319900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.395212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e7ed-96f3-4266-8792-9ee49bb5a3f4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.422525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448735ed-ccb2-482a-84d5-7f8f7a4b2cd9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.428800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.429476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.429799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.430080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.430820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:27.431159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.432561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.444434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 249/508] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:27.445251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.461044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.461762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.462050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.462332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.463223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:27.463535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.464943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.473895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 260/509] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:27.474538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.510939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.542410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.555488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07237f64-4c2e-443e-bc1b-0c172bdd6be5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.579844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12c77-34a5-4f16-b738-43b79c6f9be1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.592190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.592874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.593159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.593425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.594303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:27.594614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.596063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.617165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.617882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.618175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.618449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.619331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:27.619641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.621046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.632769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 261/510] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:27.638373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 250/511] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:27.638549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.638643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.733107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b29150-1964-48e4-99ad-3ea04e6375e6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.736872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96002-d986-4976-bb9e-b1d2d6c7f5ce None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.748437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.764224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:27.769326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.770181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.770468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.770740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.773176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.774018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.774290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.774567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.778312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.779817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.784958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.786471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:27.794693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.795637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 251/512] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.796744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:27.808106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.808964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.809830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:27.809830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:27.809830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.809830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:27.809830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 262/513] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.810387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.913312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdb5b5-b52f-4669-aadf-81ad66201897 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.917445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dacdb-b3d0-4901-9044-6e155ee80a03 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.955806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.958376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.958376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.958376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.958672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.958672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.958672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.958672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.965388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.966908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.971664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.973183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:27.982220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.983473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 263/514] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.984277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:27.996288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:27.997189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:27.998061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:27.998061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:27.998061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:27.998061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:27.998061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 252/515] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:27.998312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.026460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.039029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.100503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770405aa-28f2-496d-8fdb-2f909e402fbd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.100784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f78962-d5c6-40ac-97c7-b1eaf2872dfb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.137562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.138272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.138564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.138840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.139204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.139720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:28.139888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.140026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.140122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.140406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.141516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.158919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 253/516] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:28.159758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.214167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.215547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.251001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.261033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.268697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfa5d-2250-463a-926e-b288f1c62826 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.303512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.304190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.304472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.304745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.305475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:28.305813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.307386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.318596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 254/517] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:28.319447 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.338467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 264/518] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:28.339736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.419625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ea7f-a1d4-44bc-bdb0-2949d83651e5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.440081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7b72-618d-47bc-b1f2-c9b4e8320c51 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.452501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.453253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.453442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.453745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.454543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:28.454849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.456405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.474410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.479396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 255/519] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:28.479503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.479503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.479656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.479726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.479726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:28.479726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.479726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.481290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.484918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.491112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 265/520] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:28.491112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.586874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf3f9e-d7d5-458c-b4f1-835aa96831d8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.598339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73398a3-f915-4b4d-8b7b-cf91311aabc9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.626404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.627449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.627903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.628391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.647650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.648727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.649175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.649631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.650977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.653519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.680465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 266/521] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:43:28 2022] POST /identity/v3/users => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:28.681347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.728331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.730021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.735208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.751970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:28.809412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6eab-cc2e-4569-9f0a-ceef22689b47 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.851223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:28.852042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:28.852329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:28.852610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:28.859752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 256/522] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:28.859752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.866983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:28.867864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:28.888410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:28.889351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:28.891032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:28.891032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:28.891032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:28.891032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:28.892863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 267/523] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:28.893920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:28.972869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78534a-f7ba-4470-aaa0-c08ff6044e6c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:28.976069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.010916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186eb49-0d27-4f8c-ae10-2addb05c56d1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.012961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.013652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.013938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.014214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.015063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=7d5dafc333e54d20aebe2929e1f8a4d4) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:29.015373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.016820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.018913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.023396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 257/524] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/role_assignments?user.id=7d5dafc333e54d20aebe2929e1f8a4d4&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:29.023396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.051217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.052134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.052491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.052845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.066730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.068256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:29.092047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:29.093006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:43:29.093913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:29.094647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 268/525] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:29.095676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.196401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c8a45-5a67-4762-be13-73e408ae0ec0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.222184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce40e-67b0-4693-9601-2091865711c6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.234127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.234946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.235220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.235513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.247589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.249085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.267880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.268562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.268911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.269253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.277243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:29.277243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.277243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:29.278204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:29.279023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:29.279850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:29.279850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:29.279850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:29.279850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:29.281650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 258/526] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:29.281650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.301699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 269/527] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:29.302610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.314916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.337470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.424352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef7d3-4fd4-4ed7-8fc9-cb09782dab56 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.429083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a453e-23b4-435d-82f4-8af1703b39c5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.466404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.467100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.467386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.467665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.468522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:29.468840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.470937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.472238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.473080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.473741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.474209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.475962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:29.476458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.478191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.497716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 259/528] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:29.497716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.499036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 270/529] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:29.501176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.595761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.621230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.625644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655eb0b-439e-42c7-866f-3f9a5d1302dc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.641947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd8020-fff3-4ffa-9643-0367db5618a3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.668199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.669013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.669298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.669733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.680180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.681782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.685195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.686281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.686787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.687270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:29.699468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:29.700390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:29.701193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:29.705673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 260/530] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:29.706844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.782706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.784498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.845329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce4119-da82-4776-b29e-ddc900f4f877 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:29.890109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:29.891086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:29.891367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:29.891890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:29.893004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.903378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:29.906033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:29.908905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:29.917470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 271/531] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:29.918423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:29.927432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:29.928466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:29.929526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:29.939341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 261/532] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:29.939341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.057794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad67e0-e0c5-40d6-9031-ec8b72c84154 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.082403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c7c0a-fe6c-42cf-92ae-689f58904f40 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.102039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.103294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.103981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.104521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.105507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:30.105990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.108347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.122558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.123446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.123849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.124205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.137237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 272/533] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:30.137237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.141774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.143193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:30.164298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:30.165209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:30.166145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:30.166145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:30.166145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:30.166145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:30.166145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 262/534] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:30.167124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.195128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:30.239237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:30.255543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ada84-5689-4b14-8480-e665fa08cf75 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.291833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.292873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.293368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.293882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.294867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:30.295379 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.297024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.307315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72865daa-8224-4524-be76-d7fd226b8102 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.310143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 273/535] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:30.311122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.361514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.362357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.362781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.363357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.365099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=57ae4c65d3be47eeb52566dec6cb286c) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:30.365531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.367375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.376284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 263/536] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/role_assignments?user.id=57ae4c65d3be47eeb52566dec6cb286c&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:30.377639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.443267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8588a99-6af1-4052-8224-22436877d73c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.453574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:30.521629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.523791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.524232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.524949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.531746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:30.531746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.531746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.552017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 274/537] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:30.555235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084b90-8b5c-482f-bbd5-3ffcc1144b6a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.557778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.583185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:30.609859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.610544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.610839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.611124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.611989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=211375edc5774281947e0b47714a1a69) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:30.612309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.613790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.623202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 264/538] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/role_assignments?user.id=211375edc5774281947e0b47714a1a69&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:30.690210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6c8e3-08bd-4cd9-ab55-a08acc2075c3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.730398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.731116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.731404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.731685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.739815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.741367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3762b5c8-6913-4831-9189-c9f23457927d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:30.756777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:30.757728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:30.758551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:30.763372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 275/539] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:30.764787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.790456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fc1c-34ad-4490-9742-f0dceb4dd51b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.790776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fc1c-34ad-4490-9742-f0dceb4dd51b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.791195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982fc1c-34ad-4490-9742-f0dceb4dd51b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.794048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 276/540] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:30.801088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.801376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.801682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.831907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:30.833174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:30.875319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:30.952190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65d107-f20e-4329-8f65-360dc13cab09 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.983636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 277/541] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:31.008369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.034987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.036049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.036523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.036985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.038054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:31.038589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:31.040280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:31.062088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 265/542] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:31.072509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.142068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d2df2-ba28-49cc-9814-768b3489c5e7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.177101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.177961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.178255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.178534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.181173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:31.191038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:31.199457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:31.200328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:31.201110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 278/543] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:31.206723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.227011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:31.297391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f1de3-e94b-4384-8242-778d1be0f6fa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.320482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed460b-c5e3-45cb-b809-dbac56cf8832 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.334187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.334858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.335252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.335535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.336496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=e3808efbe570448c8780ed114d0379e2) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:31.336818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:31.338358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7893a-ad1f-42cf-a031-faf2d78f7a05 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:31.344811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 266/544] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/role_assignments?user.id=e3808efbe570448c8780ed114d0379e2&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:31.346459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa1f9b-55da-46c0-bfd6-795df3091bfc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.346752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa1f9b-55da-46c0-bfd6-795df3091bfc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.347035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa1f9b-55da-46c0-bfd6-795df3091bfc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.353290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 267/545] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:31.355319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.355617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.355900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.357981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.358679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.358964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.359244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.360025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:31.360336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:31.362031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:31.372343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 279/546] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:31.374798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:31.376095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:31.377907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.515939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 268/547] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:31.534577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:31.563765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9e24c-44cc-46a2-9b00-1813dfff6473 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.572663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.602442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.603320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.603604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.603890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.613073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:31.618875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:31.620583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:31.638867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:31.640984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:31.643066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:31.643066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:31.643066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:31.643066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:31.643066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 280/548] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:31.655894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.767343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb445484-d544-4fef-b5ea-c1e7041ccde0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.779608 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d380acc-304f-42fa-a754-f083d80a9036 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.803265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.803955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.804247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.804528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.805278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:31.805625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:31.807107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:31.809949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:31.821786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 281/549] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:31.826809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:31.918357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:31.919181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:31.919468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:31.919748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:31.940157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec753617-0028-4d1a-b540-b30a6cdbca53 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:31.952848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:31.961999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:31.963690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:31.964635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 269/550] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:31.969428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.005034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.005893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.006161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.006439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.022769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.024251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:32.046204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:32.047179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:32.048240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:32.054050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 282/551] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:32.059775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.081838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:32.096235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16470c7a-c48b-4b66-be97-aee30b984f0c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.139748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.140844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.141511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.142018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.142985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:32.143493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.145113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.156351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 270/552] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:32.162144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.179970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:32.302998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce24f6c-5be8-459f-89e3-a132d4253986 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.310713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e945-e9ee-43b9-b9b5-5f7dbb8ee002 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.344166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.350538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.350999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.351418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.371838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.372764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.373692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.374115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.375713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.376165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.377153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:32.377627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.379596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:32.409482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:32.411428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:32.413358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:32.413358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:32.413358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:32.413358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:32.416534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 271/553] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:32.421414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 283/554] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 23 11:43:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:32.423043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.423185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.434890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:32.544682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d3e53-d877-4b03-ac9a-09731d768d1f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.555814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:32.586847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.588027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.588636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.589093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.633272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107ab3a-935f-4f3e-bb51-0242899188ff None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.679091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.681144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.714167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.714849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.715297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.715708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.716704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:32.717147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.718780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.747518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 272/555] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:32.753325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.800820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 284/556] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:43:32.806565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:32.818815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:32.911100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:32.928560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7b458-dc98-4fd3-a315-f8133206c4f1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.948476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0245-c0f7-4c5e-906a-22cc5efdb483 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:32.975061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.975995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.976579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.976934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.985908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:32.987125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:32.987618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:32.988089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:32.990863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.992959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:32.997710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:32.999667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4d2a4fac-caee-418e-af80-392c3f5149a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:33.015735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:33.017169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:33.018629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:33.018629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:33.018629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:33.018629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:33.018629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 285/557] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:33.018629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb458e-e117-4c01-af1a-bde48691449a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.018983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb458e-e117-4c01-af1a-bde48691449a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.019274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb458e-e117-4c01-af1a-bde48691449a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:33.020511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:33.021789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:33.022704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:33.023342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 286/558] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:33.026080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.026530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.026877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.027080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 273/559] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:33.028199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.049169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:33.050835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:33.120204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.133594 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 287/560] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:33.134863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.163364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f988a-cfde-4e7f-bb95-ab690189de6a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.191549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.201108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.201769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.202054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.202328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.203113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:33.203416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.204794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b7df-72e8-47ab-8d58-9fb519204e6e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.216821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 274/561] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:33.218239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1244e0-9bcf-43fe-a737-50e97882673d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.218526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1244e0-9bcf-43fe-a737-50e97882673d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.218802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1244e0-9bcf-43fe-a737-50e97882673d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.220187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 275/562] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:33.220942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1244e0-9bcf-43fe-a737-50e97882673d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.246619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11897b73-9ddc-4910-862b-f484e0908c5f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.282314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.283014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.283297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.283580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.284429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:33.284738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.286340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.304621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 288/563] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:33.305298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.356866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1244e0-9bcf-43fe-a737-50e97882673d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.364992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.397416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3d832-c531-4cdf-ad52-9067587565ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.398425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3d832-c531-4cdf-ad52-9067587565ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.398710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3d832-c531-4cdf-ad52-9067587565ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.398988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3d832-c531-4cdf-ad52-9067587565ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.410316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3d832-c531-4cdf-ad52-9067587565ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9ae3d832-c531-4cdf-ad52-9067587565ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:33.418312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:33.419546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:33.420543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:33.424436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5186c30-ad6a-4993-ae20-1b2d91f010bf None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.424557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 276/564] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:33.426114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.426243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.426443 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.444286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:33.445473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:33.461996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.462902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.463186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.463481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.470785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.472262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:33.486262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:33.487205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:33.488087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 289/565] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:33.488553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.496687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.528280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 277/566] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:33.529524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.622568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273c35-0f3e-4784-8552-499cc4dba3df None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.631875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.660353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c42cd-4ff8-46fb-8155-5a63fb28d0d2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.661276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.662111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.662543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.662790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.675533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.677042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:33.695703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:33.696644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:33.697509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:33.697509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:33.697509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:33.697509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:33.698201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 290/567] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:33.699895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.700577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.700856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.701124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.701896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:33.702200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.702998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.703613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.712235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 278/568] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:33.713251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.760557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.811095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48d74-384e-4529-a0a9-cec516977031 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.822796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b012f-d277-4626-9d4f-758b6235c13e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.845532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.846229 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.846514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.846797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.847586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:33.847894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.849329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.858321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.859179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.859412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.859691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.867398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 291/569] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:33.867398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.876874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:33.884785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:33.885732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:33.886746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 279/570] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:33.887646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.895728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.973031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d856c3-37fd-4d6b-94e4-29b119ec9f3c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.983898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:33.987573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5e2d-5701-4eff-9853-cb9e3b06d8cd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.009648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.010589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.010866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.011143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.011879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:34.012192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.013588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81006daa-f278-4ad1-a674-817a2d52da1e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.023628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.024426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.024739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.025792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.025894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 292/571] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:34.026906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f692b76-a525-417a-894c-4af21a738aa0 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.027201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f692b76-a525-417a-894c-4af21a738aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.027469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f692b76-a525-417a-894c-4af21a738aa0 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.028720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 293/572] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:34.029420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f692b76-a525-417a-894c-4af21a738aa0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.040535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.042653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:34.060686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:34.061631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:34.062914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:34.062914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:34.062914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:34.062914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:34.062914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 280/573] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:34.062914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.118212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.143226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f692b76-a525-417a-894c-4af21a738aa0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.172974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985206-ff01-40ad-8136-bdd5793d42db None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.178186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.178847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.179129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.179405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.180244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=d2cc01f5555e4fdea9b883ab08c31acc) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:34.180550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.182054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.187781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 294/574] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/role_assignments?user.id=d2cc01f5555e4fdea9b883ab08c31acc&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:34.188561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.209519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.210332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.210619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.210898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.211685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:34.211999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.213685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f90ad-1cd4-4e8d-9906-b0a6c767ea47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.223492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 281/575] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:34.224645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.224947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.225228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.242952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:34.244642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:34.254655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.311501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aec535-df7e-4ed1-b5e1-97c145d1441b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.323743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 282/576] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:34.324456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.363051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.364886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.365175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.365443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.373391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.374988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:34.400147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:34.401222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:34.402458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 295/577] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:34.403922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.407875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.455218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365f5f6-f0e9-4381-b1ef-2896ec13a29e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.492216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.492805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.493086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.493360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.494239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:34.494545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.495946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.509824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 283/578] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:34.511056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.514849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.528479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aceaa4-19de-468a-bf30-fe2a266304a7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.569852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.570962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.571253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.571528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.583924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.585405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:34.607350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:34.608406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:34.609422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:34.609422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:34.609422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:34.609422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:34.609422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 296/579] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:34.609799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.642304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b60c-35ff-4a6f-8fe5-f3fbfc794ad3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.672885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.679358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.680176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.680463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.680741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.692188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:34.700467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:34.701425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:34.702309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 284/580] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:34.703933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.725754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80ab53-ab4a-4b6c-868c-a9b3d015da16 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.766516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.767297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.767588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.767977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.768790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:34.769108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.770714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.773353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.789222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 297/581] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:34.789222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.815876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f136d3-5cd0-4b59-a30a-df6c145d106c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.852312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.853320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.853980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.854097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.865368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.867141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:34.883153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:34.885134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:43:34.886529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:34.889449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 285/582] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:34.890389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:34.900840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9933-30f8-4bd9-b65f-55791cccb1af None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:34.919417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:34.939357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:34.940100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:34.940383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:34.940663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:34.941389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:34.941793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:34.943188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:34.961550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 298/583] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:34.961550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.010387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045a7fa-13d6-42aa-90c6-ca3de39c78a3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.033167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.046571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.047249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.047536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.047814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.048578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:35.048888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.050315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.058819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 286/584] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:35.063856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.073197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c92a9-c65e-4216-89e5-5f0d5ae14b9d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.109032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.110058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.110444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.110816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/7d5dafc333e54d20aebe2929e1f8a4d4/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.127621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=7d5dafc333e54d20aebe2929e1f8a4d4, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.129170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.157640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 299/585] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:34 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/7d5dafc333e54d20aebe2929e1f8a4d4/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:35.157640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.176724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f090d-5b26-4334-a1fe-2e67736a7558 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.202574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.215897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.216615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.216883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.217169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.218292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:35.218558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.220056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.246403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 287/586] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:35.247589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.298319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024c47-3495-49f0-be0a-e4e58af8e318 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.307613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.355913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.356896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.357256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.357790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.368985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.370607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.382341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c9be8-cbad-458d-be6f-b9983632e11e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:35.386825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:35.388048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:43:35.389259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:35.392104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 300/587] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:35.392104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.427170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.428123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.428480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.428951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.440621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.442189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:35.462062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:35.463556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:35.464638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:35.464638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:35.464638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:35.464638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:35.464638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 288/588] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:35.464638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.490574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.508079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed506b-5555-4823-9040-3f7bab740814 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.545370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.546533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.546981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.547407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.558960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.560662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.571618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.578717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fe8c5-ab5e-4084-b709-4a4be783be64 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:35.583260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:35.584306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:35.585387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:35.585387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:35.585387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:35.585387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:35.587548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 301/589] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:35.588537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.620203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.621069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.621430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.621813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.622748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:35.623133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.624913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.644930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 289/590] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:35.646422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.699076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1381fd-ff99-4b9e-8eb7-6dfb7f5a3a46 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.736068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.737082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.737559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.738051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.738971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:35.739804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.741465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.748955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.760098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 302/591] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:35.760098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.763784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822b4df-8aad-47e9-9709-703e2454d6fd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.810226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.811561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.812039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.812759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.814091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:35.814414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.815825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.830647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 290/592] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:35.831961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:35.852186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:35.898217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca69c6-41c4-4879-a4cc-03a56254ecdd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.947947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27d7f7-5778-4863-bfa6-35800d0dac1b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:35.948993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.951217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.951733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.952234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.967373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.969762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.984068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:35.984895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:35.985181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:35.985458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:35.994778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:35.995694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:35.996559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:35.996559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:35.996559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:35.996559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:35.996781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:35.996781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:35.998838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 303/593] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:36.000861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:36.014484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:36.015480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:43:36.016697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:36.020550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 291/594] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:36.021501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.060978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.104363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.117446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd58d36-4c71-407d-968b-2467c2d2c982 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.129126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82237aa-4bb7-40d6-ae31-a42bd01a4ce9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.156863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.158074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.158508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.158949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.166128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.166649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.167016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.167347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.168125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.168242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:36.168559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.170035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.170181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.187324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 292/595] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:36.187324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:36.191043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:36.192111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:36.193091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:36.200727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 304/596] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:36.201868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.295762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3107-acb4-40e7-9e49-b039087dc36a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.314929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d90f-47b8-45b5-97cd-f06e4a179538 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.326879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.328112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.334414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.335099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.335381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.335656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.336503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:36.336811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.338515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.352320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.353587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.353587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.353982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.359111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 293/597] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:36.360226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.365412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.366979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-70f4adff-49e3-4dd0-babb-c2e37806b3c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:36.381055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:36.382253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:36.383535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:36.387440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 305/598] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:36.388528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78559bcb-49bf-4703-84fe-fb339bcb63a8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.388911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78559bcb-49bf-4703-84fe-fb339bcb63a8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.389088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78559bcb-49bf-4703-84fe-fb339bcb63a8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.394585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 306/599] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:36.395526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78559bcb-49bf-4703-84fe-fb339bcb63a8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.480203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be90e6-93d9-4811-bf70-b9400456b4c3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.511084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78559bcb-49bf-4703-84fe-fb339bcb63a8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.527407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.528106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.528388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.528661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.529461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:36.529790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.531349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.549327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 294/600] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:36.549327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.554150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015da056-4541-406d-90c3-eafa28556604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.555078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015da056-4541-406d-90c3-eafa28556604 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.555459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015da056-4541-406d-90c3-eafa28556604 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.555801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015da056-4541-406d-90c3-eafa28556604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.568368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015da056-4541-406d-90c3-eafa28556604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.569821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015da056-4541-406d-90c3-eafa28556604 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-015da056-4541-406d-90c3-eafa28556604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:36.588412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:36.589354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:36.590257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:36.590257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:36.590257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:36.590257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:36.593947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 307/601] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:36.595973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.596636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.597151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.606200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.618394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:36.620018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:36.637958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.658032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53d59-58db-4892-a1f9-5075cc7043de None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.693996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 308/602] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:36.694910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.703581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.704485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.704918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.705352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.706363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:36.706833 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.708439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.722286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 295/603] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:36.723373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.801458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50e887-dd26-412e-8da0-da4827b32a04 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.835564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767c1f-588d-4c18-a24b-5c3ffd56039a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:36.837364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.838317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.838603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.838897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/57ae4c65d3be47eeb52566dec6cb286c/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.848452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.855516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=57ae4c65d3be47eeb52566dec6cb286c, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.856988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.885633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 309/604] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:36 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/57ae4c65d3be47eeb52566dec6cb286c/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:36.885633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.885633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:36.889123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:36.890748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:36.891623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:36.891909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:36.892735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:36.893505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:36.895964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:36.913769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 296/605] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:36.914718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:36.998025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b261f-1cda-4065-bfcf-b771f3e8be50 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.036222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.037040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.037319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.037592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.047245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc27167-47f5-48ca-afda-7f2e6a57376f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.050080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:37.058026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:37.059041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:37.059858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 310/606] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:37.061131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.100574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.101407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.101749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.102043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/211375edc5774281947e0b47714a1a69/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.122567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=211375edc5774281947e0b47714a1a69, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.124061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.141829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 297/607] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:36 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/211375edc5774281947e0b47714a1a69/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:37.142824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.145109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.168327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.219400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd8a74-ed26-418e-8b75-dcf093e5379c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.261869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c29ffa-e93a-40d4-9177-66169222ea62 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.290552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.292054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.292643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.293119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.301829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.302528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.302816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.303097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.303892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:37.304200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.305674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.310985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.312830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.320352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 298/608] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:37.322087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:37.339580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:37.340518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:37.341472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 311/609] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:37.348688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.446067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.452207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991aab5-d035-4676-a98a-a5ddcad61985 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.482723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11ecc-a5b4-4f7c-b2e7-73e4f729bc13 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.494144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.495415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.495730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.496436 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.510599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.511144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.514000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.526023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.527116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.527406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.527684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.528782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:37.529099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.530591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6da99091-0ec5-4bce-a3ac-f9a23572bd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:37.540555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:37.541531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:37.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:37.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:37.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:37.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:37.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 299/610] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:37.543796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 312/611] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:37.545644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d7034-5de8-4392-98c0-4fd96bbb32d5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.545644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d7034-5de8-4392-98c0-4fd96bbb32d5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.545644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d7034-5de8-4392-98c0-4fd96bbb32d5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.549634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 300/612] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:37.550716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d7034-5de8-4392-98c0-4fd96bbb32d5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.550894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.673244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570422d0-303a-4fc7-a341-8953e7c41e24 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.674118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d7034-5de8-4392-98c0-4fd96bbb32d5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.711002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.711960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.712394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.712765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/e3808efbe570448c8780ed114d0379e2/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.713514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.714246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.714537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.714821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.715568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:37.715882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.717970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.718387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e345a43-afd1-4937-abbf-8fbb14b94bb0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.732556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=e3808efbe570448c8780ed114d0379e2, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.734453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.737694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 313/613] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:37.740169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.740584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.740811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.753432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 301/614] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:37 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/e3808efbe570448c8780ed114d0379e2/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:37.754955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.758540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:37.761063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:37.800066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.841067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 314/615] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:37.860855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.883046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c0a96-215d-4e67-86f5-e507ac323861 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.923981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.925321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.925918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.926416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.935617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.937545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:37.954792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:37.955788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:37.956725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:37.959402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 302/616] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:37.966057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.979188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43e53-09c8-40e6-bb9c-cb7a5b8542d8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.018436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.019428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.019808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.020091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.021932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:38.032600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:38.043378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:38.044398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:38.045209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:38.049701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 315/617] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:38.051897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.088051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:38.097245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae85cf8-4818-4ed5-8e70-8093cc897acc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.135681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.136532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.136914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.137296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.138313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:38.138726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.140704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.165629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 303/618] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:38.168898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.175469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5efb-24f3-451a-8ac6-1cccf98837a2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.230416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.231022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.231305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.231586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.232353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:38.232661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.234112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.260628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 316/619] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:38.266388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.294939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382868d-e866-4fff-909d-ae2b376ec592 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.296504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:38.345347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.346207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.346487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.346760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.366463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.371699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:38.404199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:38.405180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:38.406133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:38.406133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:38.406133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:38.406133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:38.408503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 304/620] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:38.415384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.455620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:38.468671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf804fe9-e118-4e87-9346-da9c6773ccd1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.531756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.532566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.532851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.533127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.555806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.557370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:38.588736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:38.589742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:38.590608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:38.590608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:38.590608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:38.590608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:38.592332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 317/621] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:38.593891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a164b1-1cdd-4c70-81c0-775a2e303cc0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.597975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.657162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.657910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.658198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.658473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.659215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:38.659523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.662987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.686452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 305/622] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:38.692364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.728365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:38.796659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9586e73-152f-4c77-b387-9d833dd308c7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.865187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.865909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.866197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.866477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.867234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:38.867545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.869718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.896144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691d7ec-9617-455b-ab69-50f7601bd15b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:38.902490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 318/623] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:38.907924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:38.921946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:38.941593 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:38.942578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:38.942868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:38.943297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:38.952110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:38.954389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:38.973468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:38.974616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:38.975722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:38.980499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 306/624] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:38.981980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:39.078081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:39.094157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c79ae-3329-4137-ab8c-bf11f301384a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:39.142161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:39.142976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.143263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.143547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.157717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabec18-64bf-4839-ab69-d055645ab865 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:39.160478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:39.162029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:39.191076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:39.192269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:39.193404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:39.204565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 319/625] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:39.205559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:39.219831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:39.220527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.220822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.221107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.221978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:39.222300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:39.223774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:39.244446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 307/626] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:39.246227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:39.354141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:39.362285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27a846-d9e3-42aa-b3f6-78ebd83a5732 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:39.401223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:39.402012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.402302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.402586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.403457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:39.403776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:39.405365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:39.424928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 320/627] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:43:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:39.438854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:39.459831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6a51-f0e5-4c99-bb0f-e02c36ea9f61 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:39.503773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61adf7c-0ca6-43c2-b812-113d4ee4aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:39.504695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61adf7c-0ca6-43c2-b812-113d4ee4aee6 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.505015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61adf7c-0ca6-43c2-b812-113d4ee4aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.505637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61adf7c-0ca6-43c2-b812-113d4ee4aee6 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/d2cc01f5555e4fdea9b883ab08c31acc/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.509029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:39.528829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61adf7c-0ca6-43c2-b812-113d4ee4aee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=d2cc01f5555e4fdea9b883ab08c31acc, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:39.530940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61adf7c-0ca6-43c2-b812-113d4ee4aee6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:39.557891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 308/628] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:39 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/d2cc01f5555e4fdea9b883ab08c31acc/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:43:39.557891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c795e4e-2f29-4687-9034-d69229c1d518 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.557891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c795e4e-2f29-4687-9034-d69229c1d518 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.557891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c795e4e-2f29-4687-9034-d69229c1d518 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.562247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 309/629] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:39.565470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae8918-db63-44d2-873f-b0d8bdaa4b61 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.565786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae8918-db63-44d2-873f-b0d8bdaa4b61 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.567183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae8918-db63-44d2-873f-b0d8bdaa4b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.571466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475c71b-785b-4baa-b1ba-1bb577558b22 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:39.603970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e9ae8918-db63-44d2-873f-b0d8bdaa4b61 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:39.607317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e9ae8918-db63-44d2-873f-b0d8bdaa4b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:39.611991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:39.632325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:39.633267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.633742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.634195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.697740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 310/630] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:39.699551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ca9b-ee23-4962-937a-189de544117a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.699938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ca9b-ee23-4962-937a-189de544117a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.700325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ca9b-ee23-4962-937a-189de544117a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.702214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 311/631] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:39.707744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:39.708164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:39.708549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:39.729741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:39.732095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:39.738566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:39.740316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:39.833231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 312/632] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:39.834211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:39.872450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 321/633] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:43:39.873264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:39.889854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:39.904340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:39.963252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f151ced-3ef8-4585-a124-03d7520ce9c4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.000519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.001534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.001967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.002338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.003679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d72127-9772-488f-a665-b97e205a9332 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.013588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:40.021358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.022403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:40.023209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:40.025198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 313/634] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.025198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.052951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.053832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.054374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.054661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.073788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:40.084160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.085541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:40.087135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 322/635] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.088739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.142916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009dd3a-1b39-4778-a1b6-98c527446f97 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.146571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.187473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.188563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.189020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.189442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.201699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.204654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.206283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.219645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e926a05-51ef-4a50-87ff-ac8da1005668 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:40.224388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.225245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.226169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:40.226169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:40.226169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:40.226169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:40.226169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 314/636] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.226456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.263301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.263984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.264264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.264545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.265969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:40.265969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.267066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502da1a-2983-4417-a302-9ca8ea5c7fea None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.280511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 323/637] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:40.282015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4c9e9-9070-4367-8f2b-986bb7cbf1d2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.282260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4c9e9-9070-4367-8f2b-986bb7cbf1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.282542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4c9e9-9070-4367-8f2b-986bb7cbf1d2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.286062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 324/638] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:40.286062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4c9e9-9070-4367-8f2b-986bb7cbf1d2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.335311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc396fe9-668e-462c-9e9e-bc4569918fb4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.376326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.377137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.377424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.377732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.378495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:40.378807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.380188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.389648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 315/639] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:40.391119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.394406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4c9e9-9070-4367-8f2b-986bb7cbf1d2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.419382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.430234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.431001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.431290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.431568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.432300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:40.432607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.434015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42a732-6aa4-48fd-8f61-3d5d759da89f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.450821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 325/640] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:40.450821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.450821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.450821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.462085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.469048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:40.470498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:40.514456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2ff6b-4ed7-4da4-9e11-9eea586752ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.545830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 326/641] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:40.545830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.554616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.555431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.555717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.556285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.570926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.572480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:40.590974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.591909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.592790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:40.592790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:40.592790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:40.592790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:40.592790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 316/642] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.593057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.669710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.672035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ef394-4dc2-45b7-a84e-728f85a3d5c8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.701200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18048934-2091-4b36-9c62-b52c5774960c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.710285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.711452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.712026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.712730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.715888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.730200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.732602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.736213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.737019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.737301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.737573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.745177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.746684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:40.753069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.754163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.755048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:40.755048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:40.755048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:40.755048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:40.755048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 327/643] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.761110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:40.762775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.763871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 317/644] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.765829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.875665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c52e-d436-4ad5-a0ea-b7fbd53dd941 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.885204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a7d9-9604-48de-984e-3e0044541f24 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:40.911831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.912640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.912926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.913208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.919375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:40.924616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:40.928273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:40.928952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:40.929241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:40.929522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:40.930290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:40.930604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:40.932133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:40.932653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:40.933501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:40.934373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 328/645] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:40.935043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.952682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 318/646] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:40.952682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:40.993899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.048032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185fb9b-3c8c-4b95-9ef8-5a9714a07f70 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.059660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ece36f-4f9c-430d-8aec-4c56e72c2bc6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.084912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.085586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.085986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.086174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.086908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:41.087305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.088705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.094862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.095544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.095829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.096111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.096912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:41.097227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.098708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.101484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 329/647] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:41.102344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.121759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 319/648] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:41.121759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.175464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.210427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e27751-3c51-44f4-ac55-02415b76da72 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.220119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.231749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da131d5-7a50-40cd-a86d-38a5f7df3605 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.250224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.251031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.251314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.251605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.252380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:41.252692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.254118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.263778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 330/649] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:41.264604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.275325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.276457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.276932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.277387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.285250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.287075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:41.302230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:41.303212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:41.304114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 320/650] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:41.304689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.380954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c2059-da65-46ed-8cb6-f5181b5aa7cf None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.410741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee048a-522a-4fad-a7dc-399400860a0b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.417026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.417868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.418158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.418438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.422304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.426667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.428069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:41.443809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:41.444805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:41.445731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 331/651] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:41.446324 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.456516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.457249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.457543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.457856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.458712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=7d5dafc333e54d20aebe2929e1f8a4d4) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:41.459027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.460477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.467620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 321/652] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/role_assignments?user.id=7d5dafc333e54d20aebe2929e1f8a4d4&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:41.468448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.495468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.596021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbefae-fcea-4cd7-8312-6414ab4de576 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.622144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e416f3e-b354-4979-858a-dcef99ace91d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.651775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.652008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.652295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.652637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.663092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.663771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.664054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.664328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.665245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:41.667836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.667966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.667966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.668189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:41.689282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:41.690516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:41.691386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:41.691386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:41.691386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:41.691386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:41.691610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 322/653] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:41.692384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.694272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 332/654] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:41.697084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.732971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.791952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.811755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a2e0-508a-494a-afc4-53fb57fbb0b9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.811984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866e2ed-d329-467b-b372-c0f97b42e1f1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:41.849189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f369a-3224-4f91-8998-130fd3b9a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.849890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f369a-3224-4f91-8998-130fd3b9a798 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.850175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f369a-3224-4f91-8998-130fd3b9a798 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.850456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f369a-3224-4f91-8998-130fd3b9a798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.851430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:41.852115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:41.852402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:41.852789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:41.853946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:41.854979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.855723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.886868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 323/655] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:41.886868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:41.936331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f369a-3224-4f91-8998-130fd3b9a798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:41.937928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f369a-3224-4f91-8998-130fd3b9a798 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:41.986452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:41.998269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c323-bf08-4a8e-86bc-8ae0d28cd95b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.028332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.036106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.036773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.037054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.037329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.038095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:42.038402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.039798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.053691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 333/656] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:43:42.053691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35bdb5-943b-4713-bc5e-30f32e54b925 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.053691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35bdb5-943b-4713-bc5e-30f32e54b925 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.053691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35bdb5-943b-4713-bc5e-30f32e54b925 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.054072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 334/657] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:42.054660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35bdb5-943b-4713-bc5e-30f32e54b925 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.056044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 324/658] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:42.056989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.169164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35bdb5-943b-4713-bc5e-30f32e54b925 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.175548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd69c-d1eb-4150-84ec-0e6d3b0b9f09 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.214919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d25b70-6110-40de-83c2-29f307557815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.215168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.215591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d25b70-6110-40de-83c2-29f307557815 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.215878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d25b70-6110-40de-83c2-29f307557815 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.215987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.216146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d25b70-6110-40de-83c2-29f307557815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.216249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.216457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.229129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.230763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:42.250512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:42.251439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:42.252312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:42.252312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:42.252312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:42.252312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:42.252312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 325/659] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:42.253015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.255733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.276938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.297184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d25b70-6110-40de-83c2-29f307557815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.298707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d25b70-6110-40de-83c2-29f307557815 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.360298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a2db-e227-4296-b13f-fc10db95701e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.398855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.400179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.400466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.401016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.410491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 335/660] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:42.410491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.410491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.410491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.410923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.412097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.427523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:42.428532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:42.429416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:43:42.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:42.431179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:42.431259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 326/661] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:42.431259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.503197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.508997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 336/662] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:42.509899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.528296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.559474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292ba40-2c08-4ced-bb87-09976e4834db None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.602820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.602820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.602820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.602820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.603249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:42.603249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.604255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.618717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 327/663] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:42.619677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.634690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2c567-0f81-4c05-b090-1cc4d2c13c7f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.678696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.679940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.680442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.680933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.692071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.693526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:42.713792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:42.714932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:42.715815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:42.715815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:42.715815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:42.715815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:42.715815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 337/664] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:42.716085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.741093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462c60c-816d-49b2-845c-d8fe07fac161 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.767952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.782854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.783049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:42.783904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.784389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.784686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.785592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:42.786084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.787476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.807836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 328/665] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:42.812983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.823260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3a00-297d-4932-8438-da82b6f0d75e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.863368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.864947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.865474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.865796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.879495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:42.890108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:42.891317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:42.892251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:42.893941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 338/666] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:42.894987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:42.924761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06c467-63ab-420a-a9a9-df0bf00fbeea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:42.963359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:42.964210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:42.964509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:42.964825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:42.972047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:42.973534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:42.988508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:42.989809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:42.990684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 329/667] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:42.991811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.009526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f3a05-b974-4605-b933-17af31d9fa71 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.036630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.039040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.054769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.055541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.055883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.056367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.057112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:43.057421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.058889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.071076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 339/668] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:43.072007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.103561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c2dd-473e-4661-b172-4136040c94c8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.144212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.145316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.145791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.146108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.183856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8bdd-54d3-4499-9d3a-a3a96a32ebd1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.219580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.220254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.220538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.220811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.221440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.221556 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:43.221888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.223267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.223497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.237782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 340/669] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:43.237782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.268128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.289376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.334865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 330/670] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:43.335853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.353287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca46a12-5ae6-4a49-afb9-7dcd7192e1b5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.389226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.390066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.390362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.390634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.391439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:43.391753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.393213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.405743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 341/671] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:43.410883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.454819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3674-85a1-4f5f-a112-2e1c6e73c227 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.493660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.494475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.494779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.495043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.502705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.504175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.507305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:43.519748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:43.520676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:43.521540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 331/672] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:43.522808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.532729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8272d1e-9436-4854-932a-e700db6ae629 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.541894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.569742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.570555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.570837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.571112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.589629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.589629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:43.609097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:43.610140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:43.611005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:43.611005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:43.611005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:43.611005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:43.611005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 342/673] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:43.611549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.669511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6085dd1-fc42-4719-9867-885bcbd1e1ba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.704226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.705022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.705299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.705569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.716940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.718445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.721933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27adbad-dd66-462e-886c-b2a6dc9fba34 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:43.736571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:43.737496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:43.738389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:43.738389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:43.738389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:43.738389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:43.738389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 332/674] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:43.739081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.762518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.763260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.763542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.763847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.764697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=211375edc5774281947e0b47714a1a69) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:43.765018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.766504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.785637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 343/675] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/role_assignments?user.id=211375edc5774281947e0b47714a1a69&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:43.785637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.796979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.799887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:43.853408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9322ee-7c6b-4702-8c7e-45377633e80b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.890686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854a837-703f-447c-8622-483a0ba64bba None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:43.896092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.896885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.897243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.897593 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.898517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:43.898950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.900573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5eb92c-c0e4-4f6a-9091-6d451d729ac1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.914164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 333/676] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:43.915787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd05a-c1e3-4153-a86c-d4a570ba7c92 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.916081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd05a-c1e3-4153-a86c-d4a570ba7c92 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.916362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd05a-c1e3-4153-a86c-d4a570ba7c92 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.921649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 334/677] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:43.921649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd05a-c1e3-4153-a86c-d4a570ba7c92 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:43.940176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:43.940862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:43.941150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:43.941433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:43.942214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:43.942526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:43.943916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:43.958738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 344/678] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:43.959631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.053083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd05a-c1e3-4153-a86c-d4a570ba7c92 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.053408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.067209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.080541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf891-b0f5-47fc-b97d-a55910dc09df None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.091879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.093250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.093537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.094167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.094920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:44.095233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.096639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7b8c9-5064-488a-954f-9e4f62017a59 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.109300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 335/679] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:44.109300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.109300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.109300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.126267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.126962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.127249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.127531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.128378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=57ae4c65d3be47eeb52566dec6cb286c) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:44.128707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.130215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.130508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:44.131702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:44.145986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 345/680] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:43 2022] GET /identity/v3/role_assignments?user.id=57ae4c65d3be47eeb52566dec6cb286c&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:44.145986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.218898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 336/681] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:44.219859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.259015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd2f8b-6393-4c0d-b034-6a8cc0966cda None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.311899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.312669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.313035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.313315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.323389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.325005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:44.341864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:44.342842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:44.343840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:44.344410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90631f-e8d7-4b07-8478-2bd22d864af8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.345681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 346/682] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:44.347469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.348341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.358802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.393009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.393498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.393876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.394154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.402990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.404494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:44.420031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:44.421059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:44.421986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 337/683] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:44.422919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.487822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11b82d-6476-47a3-8c23-ca4e366c6f61 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.526216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.527088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.527377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.527660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.536500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51cf83-c08d-48ed-8d05-eb410509b034 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.539046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:44.547615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:44.548572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:44.549419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 347/684] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:44.550725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.579896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.580951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.581534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.582048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.583143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:44.583646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.585516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.610956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 338/685] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:44.612270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.632409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.639283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.673635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02b68-a21b-45a8-8020-f193b4dcb05f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.710461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.711593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.712484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.713021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.714191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:44.714713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.716430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.730517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d1c3b-fe4c-4dec-a329-d84b549859e2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.730850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 348/686] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:44.732436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.773961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.776376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.776675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.776953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.777813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:44.778127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.779565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.791589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 339/687] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:44.793349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.851336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5deeb-059e-403c-84f6-045cb71abf51 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.882920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.884018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:44.895554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499f64c-721e-4368-9464-b2011232179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.896526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499f64c-721e-4368-9464-b2011232179f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.897030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499f64c-721e-4368-9464-b2011232179f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.897447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499f64c-721e-4368-9464-b2011232179f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.902930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63590f6-e6be-4291-9f97-850ea4fe5347 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:44.937872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:44.938542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:44.938877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:44.939160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:44.940026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=e3808efbe570448c8780ed114d0379e2) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:44.940342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.941856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:44.958590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 340/688] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/role_assignments?user.id=e3808efbe570448c8780ed114d0379e2&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:44.959137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:44.976653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499f64c-721e-4368-9464-b2011232179f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:44.978672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499f64c-721e-4368-9464-b2011232179f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.093397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 349/689] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:45.103118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499f64c-721e-4368-9464-b2011232179f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.129633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40f9d8-449b-4b2a-8ebc-787d1400a524 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.155413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:45.161626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.161626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.161626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.161626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.178279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.178279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:45.193477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:45.194471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:45.195321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:45.195321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:45.195321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:45.195321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:45.195321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 341/690] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:45.196214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:45.201101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.288110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499f64c-721e-4368-9464-b2011232179f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.313092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6506e5-b5ed-4685-9d4e-e3d61fa0f0a5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.326220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.327026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.327309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.327584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.339501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.340981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.349309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.350039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.350379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.350664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.351414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:45.351728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.353238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:45.362554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:45.363425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:45.364689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:45.364689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:45.364689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:45.364689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:45.364689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 350/691] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:45.366463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 342/692] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:45.371061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.371906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.464273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:45.469129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:45.501268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7eaa-9784-411f-b049-fbc101c22178 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.516746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c8604-d174-4daf-a316-e55164154bd9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.546084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.546816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.547104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.547413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.548383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:45.548695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.550740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.555316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.556748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.557436 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.557941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.567484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 351/693] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:45.570967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.573161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.573756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:45.590418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:45.591399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:45.592340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:45.595089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 343/694] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:45.616695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.729871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180cad0-7f47-4c94-8b6f-63c759dd548a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.750641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:45.757932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37700a-492a-48f1-b1a5-6bd9d694e5eb None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.774571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.775909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.776398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.776903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.777992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:45.778502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.780256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.804184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 344/695] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:45.806916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.838066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.838976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.839305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.839592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:45.858996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:45.860731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:45.865446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:45.886859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:45.887819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:45.889121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 352/696] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:45.894115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:45.926274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3620ce-c406-4c05-9c94-0089bdff4ad2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:45.966175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:45.967264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:45.967751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:45.968225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.043861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.045796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.050029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.071060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471132-edde-4f99-a6a1-bea8227eb1c9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.137115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.137763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.138085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.138302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.139106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:46.139415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.140866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.161787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 345/697] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:43:46.164554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.166021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 353/698] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:46.171507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.239039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.254480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.280604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6a22-1d9f-4e4d-8199-78980455b3c8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.286220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ada61a-6cb8-433d-91c4-898576be32f1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.319101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.320274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.320780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.321304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.321872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.322768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.323069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.323353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.324209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=d2cc01f5555e4fdea9b883ab08c31acc) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:46.324546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.326230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192a75-5fca-46ce-9c3d-bd30d8584ae6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.334317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.336091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.337843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 354/699] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/role_assignments?user.id=d2cc01f5555e4fdea9b883ab08c31acc&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:46.340007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304cab4-6ca8-43c2-8509-47275202769e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.343361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304cab4-6ca8-43c2-8509-47275202769e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.343940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304cab4-6ca8-43c2-8509-47275202769e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.351537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 355/700] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:46.357252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.357886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.358370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:46.373431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:46.374479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:46.375342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:46.375342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:46.375342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:46.375342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:46.382098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 346/701] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:46.384097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.398918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:46.403180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:46.507972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 356/702] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:46.556346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.559372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b6da-3705-420d-b390-5b0572dcd850 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.619380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.630567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.630567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.630567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.630567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.632127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:46.632447 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.634007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.640057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.656345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 347/703] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:46.657911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.702040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb771c-1bbb-443f-b224-e62e04580ff0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.743843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.744805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.745189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.745557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.757420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.759292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9e23284e-2d2e-43b5-b4fb-312fe608acf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:46.779471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:46.780585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:46.781515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:46.781515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:46.781515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:46.781515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:46.781515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 357/704] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:46.782206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa12b-822b-4197-b3d6-6d358fbc53d4 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.782496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa12b-822b-4197-b3d6-6d358fbc53d4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.782793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa12b-822b-4197-b3d6-6d358fbc53d4 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.784386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 358/705] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:46.786722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554e406-1b8b-47f9-b00d-a2a722d51043 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.789163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa12b-822b-4197-b3d6-6d358fbc53d4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.822647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.823458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.823739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.824009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.832894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.835238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e97ecacc-1abb-4011-ada1-528e6f1d132c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:46.852680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:46.853959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 348/706] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.860123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.860736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.879528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:46.881055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:46.919219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa12b-822b-4197-b3d6-6d358fbc53d4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:46.922195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.935679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:46.965634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 349/707] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:46.965634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:46.972503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:46.973501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:46.974013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:46.974472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:46.975468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:46.975923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:46.977653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:46.997847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 359/708] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:46.999763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:47.080924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61cd3a-920a-4d5a-9d4d-478ecaa8900a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.117024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.117901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.118424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.118837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.119735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:47.120138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.121124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41449a-129d-4142-8afb-2eda202b4e16 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.121854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.139298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 350/709] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:47.139298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:47.168232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.169361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.169913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.170367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.171282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.173066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.178976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:47.207742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 360/710] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:43:46 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:43:47.207742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:47.257591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:47.295207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d1e9b-a913-4461-aea1-5d10f5683461 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.369758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.370610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.370895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.371174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.371852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.373270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:47.407127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:47.408158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:47.409001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:47.414818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 351/711] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jun 23 11:43:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:47.418136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:47.429383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d17d9-2597-4864-bc90-69e3f575b6c3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.475090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.475764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.476049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.476321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.477171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=7d5dafc333e54d20aebe2929e1f8a4d4) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:47.477513 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.479459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b04a3-6d2f-430c-8efb-c78ff8fbbb1c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.489685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 361/712] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:47 2022] GET /identity/v3/role_assignments?user.id=7d5dafc333e54d20aebe2929e1f8a4d4&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:47.549084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39606b74-c780-4cda-8015-aa347e829114 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.550837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:47.557629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b971-44bc-4300-af08-ac335b2ae8b9 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.557977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b971-44bc-4300-af08-ac335b2ae8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.558171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b971-44bc-4300-af08-ac335b2ae8b9 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.559771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 362/713] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:47.571272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.571667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.572010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.592749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:47.594066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:47.636714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.637416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.637727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.638007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.639065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:47.639387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.641073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.653129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 352/714] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 23 11:43:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:47.655088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:47.709704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 363/715] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:47.730291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:47.747326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:47.808977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded5d8-a528-47ee-b91a-c57e36b3accb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.892742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27d7b-0028-4894-9a1c-4186600faba3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:47.914301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.915393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.915877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.916357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.917302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:47.917853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.920261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.937244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 353/716] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 23 11:43:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:47.953274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:47.954517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:47.954997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:47.955468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:47.956340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:47.957979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:47.973070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:47.974401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:47.975219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:47.978128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 364/717] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:47 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:47.986142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:48.037432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:48.160094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7ade-6d24-48f4-bfb7-6e018be36681 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:48.199075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:48.199761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:48.200049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:48.200329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:48.201060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] RBAC: Adding query filter params (name=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:48.201372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:48.202823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd0b8d-e05c-4294-90ed-52e481432897 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:48.207990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 354/718] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:43:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:48.213253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:48.338003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:48.375768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409c5ec-b810-48ec-b635-ecb1f42fe6d6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:48.442357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:48.443061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:48.443352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:48.443634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:48.444368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] RBAC: Adding query filter params (type=network) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:48.444679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:48.446195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8d5c1-a6eb-4ecc-8a9c-c53280a5355d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:48.453403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 365/719] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:43:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:48.756512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5590a-0cd7-4c0e-a4d1-7323484f4d50 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:48.756905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5590a-0cd7-4c0e-a4d1-7323484f4d50 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:48.757131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5590a-0cd7-4c0e-a4d1-7323484f4d50 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:48.758918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 355/720] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:48.764688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:48.764986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:48.765258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:48.784058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:48.785254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:48.876191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 366/721] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:48.911856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5590a-0cd7-4c0e-a4d1-7323484f4d50 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:49.042326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:49.054795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5590a-0cd7-4c0e-a4d1-7323484f4d50 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:49.103520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:49.104335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:49.104618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:49.104891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:49.122268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:49.129870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:49.130761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:49.131587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 356/722] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:49.138545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:49.278008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:49.290246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec814-37b4-4f86-86ef-ec1ab3e1bc0d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:49.325796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:49.326485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:49.326774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:49.327059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:49.327822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:49.328137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:49.329644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:49.338772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 367/723] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:49.344292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:49.507490 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018439b7-6a1e-4d9b-a7b2-58abb9b8d19e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:49.544893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:49.545730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:49.546067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:49.546342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:49.558208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:49.559709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:49.577440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:49.578402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:49.579289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:49.579289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:49.579289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:49.579289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:49.579289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 357/724] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:49.585765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:49.730054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23be5c4-bf1b-42c0-95ac-4fee390b67dd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:49.769080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:49.769795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:49.770082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:49.770361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:49.771171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:49.771486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:49.772867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae80ade-6d4c-4b22-8b5a-a6ce30897a2d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:49.774528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:49.788948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 368/725] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:49.795239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:49.808774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:49.940571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20df15-7aa4-4a05-833b-6d60974529b8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:49.985181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:49.986024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:49.986310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:49.986587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:49.995915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:49.997407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:50.014835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06f52-674f-42b5-95a3-beefe48d76f5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.015151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06f52-674f-42b5-95a3-beefe48d76f5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.015391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06f52-674f-42b5-95a3-beefe48d76f5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.017085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 369/726] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:50.017333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:50.018288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:50.019266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:50.022504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff96ab-1bb9-44aa-86bf-d3403dd9dafd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.022773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 358/727] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:50.023045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff96ab-1bb9-44aa-86bf-d3403dd9dafd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.023332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff96ab-1bb9-44aa-86bf-d3403dd9dafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.031489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.046114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-66ff96ab-1bb9-44aa-86bf-d3403dd9dafd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:50.047309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-66ff96ab-1bb9-44aa-86bf-d3403dd9dafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:50.136838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.147227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 370/728] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:50.147997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d249d7-874b-4e94-ab33-053ffd4f3c01 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.148286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d249d7-874b-4e94-ab33-053ffd4f3c01 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.148564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d249d7-874b-4e94-ab33-053ffd4f3c01 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.158858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 371/729] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:50.164799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.165137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.165419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.189254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45f315-acff-4bcd-aa70-3bcfaa1a90a7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.191877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:50.193105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:50.239733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.241531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.242036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.242491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.243840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:50.244791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:50.247261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:50.271016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 372/730] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:43:50.271016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.280574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 359/731] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:50.287934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.349827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.399186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f4b4-8c16-49aa-b830-177e0ead4f04 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.400426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687faee-4bfb-491c-a4ff-6ddb085fbbe6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.427317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.436908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.438062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.438476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.438944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.440385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.441355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.441930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.442512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.450960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:50.459293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:50.460295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:50.461132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:50.466196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 373/732] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:50.467261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.520573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:50.522704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:50.577676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29213d-8671-4e06-9640-f464657f1779 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.592939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.615480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203a8f4-a397-477c-9181-4e03bbbe62e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.616295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203a8f4-a397-477c-9181-4e03bbbe62e2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.616591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203a8f4-a397-477c-9181-4e03bbbe62e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.616877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203a8f4-a397-477c-9181-4e03bbbe62e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.627986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203a8f4-a397-477c-9181-4e03bbbe62e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:50.635198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 360/733] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:43:50.636056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a203a8f4-a397-477c-9181-4e03bbbe62e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:50.636676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:50.637572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:50.638415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:50.641109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 374/734] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:50.642717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e24a-2b95-428f-8338-e67c26fbdc89 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.643179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e24a-2b95-428f-8338-e67c26fbdc89 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.643623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821e24a-2b95-428f-8338-e67c26fbdc89 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.645302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 375/735] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:50.646183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e24a-2b95-428f-8338-e67c26fbdc89 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.668601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.747475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db57f-871a-4579-8735-949cfffde485 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.761420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821e24a-2b95-428f-8338-e67c26fbdc89 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.785678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.786277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.786577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.786836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.787612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:50.787898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:50.789427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:50.796920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.797855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.802498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.802618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 361/736] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:50.802698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.802790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.813891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:50.815367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6c17b33f-1a37-4bf0-b481-52157b21738c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:50.833442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:50.834409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:50.835273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:50.835273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:50.835273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:50.835273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:50.835273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 376/737] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:50.835991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.836270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.836552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.856049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:50.857385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:50.881134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.905048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:50.921520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89480e6-0bb5-4c9c-a767-f031d0134aa1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:50.934540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 377/738] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:50.935365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:50.975362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:50.976051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:50.976331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:50.976605 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:50.977363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:50.977735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:50.979223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:50.992983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 362/739] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:50.992983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.051295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bafbf-27cc-4523-9491-b4857894d3af None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.087375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.088327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.088655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.088930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.095306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90544eec-6766-443f-8548-6516fb4e68f0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.099485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.100946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:51.120726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:51.121834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:51.122707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:51.122707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:51.122707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:51.122707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:51.122707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 378/740] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:51.123139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.132540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.133197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.133482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.133828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.134164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.134563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:51.134876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.136341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.148500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 363/741] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:51.149361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.159850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.232215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc39d1-6494-4ac5-8dec-875269d0c7c5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.250154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846a071-d0fa-45bf-b768-1f2d62bdad22 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.269425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508151ed-213f-4f05-bff1-89ff2f67c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.270135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508151ed-213f-4f05-bff1-89ff2f67c38a None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.270406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508151ed-213f-4f05-bff1-89ff2f67c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.270679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508151ed-213f-4f05-bff1-89ff2f67c38a None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.271410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508151ed-213f-4f05-bff1-89ff2f67c38a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.272830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508151ed-213f-4f05-bff1-89ff2f67c38a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.289023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.289230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 379/742] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:43:51 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:51.289858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.290591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.290795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959493da-b593-407f-908a-74138bd756f1 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.290987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.291063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959493da-b593-407f-908a-74138bd756f1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.291131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959493da-b593-407f-908a-74138bd756f1 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.292411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 380/743] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:51.293308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959493da-b593-407f-908a-74138bd756f1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.311713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.313145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:51.334385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:51.335361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:51.336215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:51.336215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:51.336215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:51.336215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:51.336215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 364/744] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:51.337266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.385950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.409334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.440265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959493da-b593-407f-908a-74138bd756f1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.463205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8e27-dc51-4df7-86c8-f87e6fe25321 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.482885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.483726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.484107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.484489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.485334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:51.485817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.487307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b8ff6-91e1-460c-8828-4c13d5b5c9d4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.500537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 381/745] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:51.502085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.502425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.502711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.507514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.508363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.508869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.509003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.516800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.523872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.525341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:51.526621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:51.542844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:51.544085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:51.545121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:51.548777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 365/746] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:51.549683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.621624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 382/747] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:43:51.621624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.681676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.683132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff4b6-491e-4ec2-9116-ece0e4042621 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.704314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.723311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.723992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.724276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.724554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.725291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:51.725623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.727030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.733166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818345c8-6760-4444-bc4d-a8df223622c8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.740353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 366/748] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:51.741200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.778973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.780107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.780589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.780864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.788579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.790145 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:51.806327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:51.807317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:51.808239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 383/749] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:51.808840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.863032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e256-3ba6-4003-b0e9-7b20fe09edaa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.902452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.903124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.903410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.903794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.904592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:51.904903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.906499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.916325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144523b9-79aa-476e-b013-f7c512b98d58 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:51.919127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 367/750] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:51.919934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:51.937054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.963493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:51.964910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:51.965350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:51.965827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:51.966235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:51.967208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:51.969275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:51.993636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 384/751] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:43:51 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:51.993636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.058244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6569102-4316-4736-bc84-58b9956c3099 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:52.117935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:52.119820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:52.120132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:52.120422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:52.124840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a096-580c-4fa1-9d4c-2df8a7209c99 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:52.131578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:52.133199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:52.152584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:52.154011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:52.154950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 368/752] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:52.156776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.176851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:52.177973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:52.178267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:52.178696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:52.179607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:52.179921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:52.182599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:52.205635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 385/753] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 23 11:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:52.205635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.235862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:52.287842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:52.298142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c10d4-b75d-4dea-adbb-d430a4440dfe None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:52.329910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5b33d-2027-4591-a5e0-9ed347da399a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:52.340965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:52.342420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:52.342910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:52.343690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:52.345046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=d2cc01f5555e4fdea9b883ab08c31acc) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:52.345573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:52.348035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:52.355859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 369/754] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:52 2022] GET /identity/v3/role_assignments?user.id=d2cc01f5555e4fdea9b883ab08c31acc&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:52.357139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.371963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:52.372943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:52.373244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:52.373532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:52.374606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:52.374921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:52.377158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:52.408234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 386/755] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:43:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:52.413500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.549669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758762b-0356-4d68-b6bc-76224280cb3c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:52.595020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:52.596152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:52.596638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:52.597145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:52.613648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:52.636233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:52.651983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5012c-80f9-48e9-9a96-1c4322f2ab6c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:52.697964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:52.701385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:52.701929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:52.702407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:52.709141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:52.715069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:52.729625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:52.731543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:52.764975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:52.766012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:52.767011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:52.767011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:52.767011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:52.767011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:52.782005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 387/756] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:52.794717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.856195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 370/757] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:43:52.864766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:52.976229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:52.977821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84b4d7-7fc4-490b-ba98-f02623393bcd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.044940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.045641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.045935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.046217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.046967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:53.047281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.049965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.057974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:53.060197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05d572-c192-4392-9cb6-4bf017f68dd1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.074215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 388/758] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:53.080555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.128680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.129808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.130240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.130661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.147176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.151749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:53.185146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:53.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:53.187446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:53.187446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:53.187446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:53.187446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:53.187660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 371/759] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:53.193823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.260911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4afe-e6e0-4ec9-97fa-e25129190cf9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.309415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9723039-9a00-49cc-b31f-af8a253fad3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.333957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:53.337931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.338755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.339039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.339323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.348817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.350382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:53.369481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:53.370468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:53.371365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 389/760] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:53.377294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.407011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.408144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.408672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.409160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.410123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:53.410647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.412241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76537edf-6491-4043-91e3-2562e59239c7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.432334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 372/761] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:53.433722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6e72b-ded1-4258-a1bf-109b3ad8e455 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.434009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6e72b-ded1-4258-a1bf-109b3ad8e455 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.434282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6e72b-ded1-4258-a1bf-109b3ad8e455 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.439542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 373/762] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:53.440271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6e72b-ded1-4258-a1bf-109b3ad8e455 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.456806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:53.507834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2f555-1eba-4630-a20f-3cd136da8c37 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.543454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.544413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.544873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.545324 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.546394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:53.546928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.548541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd049f-9382-458a-a55d-10734e5d46b8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.558686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6e72b-ded1-4258-a1bf-109b3ad8e455 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.566709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 390/763] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:53.568397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.568850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.569298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.588136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:53.590378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:53.597118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.598073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.598361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.598653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.610445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.610445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:53.624789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:53.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:53.626613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 374/764] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:53.627552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.681738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:53.689751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 391/765] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:43:53.692197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.776955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:53.796798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923d488-fdee-4bd0-bce7-ab30e7c268f5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.840814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.841759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.842041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.842317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/7d5dafc333e54d20aebe2929e1f8a4d4/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.844599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=7d5dafc333e54d20aebe2929e1f8a4d4, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.846085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:53.862965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d34f11-84ee-4ef2-aa73-33f960566ec8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:53.866086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 375/766] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:53 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/7d5dafc333e54d20aebe2929e1f8a4d4/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:53.867043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:53.961759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:53.962512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:53.962801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:53.963082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:53.967359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:53.967732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:53.969223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.003766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 392/767] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:54.009947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:54.052751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:54.066755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d4df4-88e9-407d-9a6d-2a04fda74cf7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:54.121095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57660403-defd-4250-b520-64687fefe877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:54.122679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660403-defd-4250-b520-64687fefe877 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.122965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660403-defd-4250-b520-64687fefe877 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.123403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660403-defd-4250-b520-64687fefe877 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.124224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57660403-defd-4250-b520-64687fefe877 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:54.125940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57660403-defd-4250-b520-64687fefe877 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-57660403-defd-4250-b520-64687fefe877 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:54.143325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:54.145351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:54.146751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 376/768] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jun 23 11:43:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:54.151454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57660403-defd-4250-b520-64687fefe877 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:54.170605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5b2a-b179-4422-a796-5f1f7bab142b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:54.187297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:54.217700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:54.218430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.218716 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.218995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.219916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=60818dbaf4ec4ec998f93a603bafa773) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:54.220234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:54.221747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.228729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 393/769] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:43:54 2022] GET /identity/v3/role_assignments?user.id=60818dbaf4ec4ec998f93a603bafa773&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:54.347245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57660403-defd-4250-b520-64687fefe877 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:54.391315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:54.392018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.392304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.392586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.393321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:54.393653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:54.395411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9afd-f696-4cca-a86f-d21b72104c32 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.401823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 377/770] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 23 11:43:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:54.407630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:54.420936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540af51-93cc-47e6-8553-b906a959ffd5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.421317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540af51-93cc-47e6-8553-b906a959ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.421485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540af51-93cc-47e6-8553-b906a959ffd5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.423285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 378/771] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:43:54.429422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.429783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.430025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.450899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:54.453563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:54.489075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:54.584713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 379/772] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:43:54.625354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:54.631521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e999-8c84-4423-9a8f-536befcb2549 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:54.667648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:54.668576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.669005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.669450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.670344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:54.670871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:54.672487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.678129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 394/773] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 23 11:43:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:54.683920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:54.738031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:54.826475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b5510-1342-4abc-b5e2-993273baad9a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:54.861104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb54eb7-40c3-4e0a-8a81-df8a5a509723 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:54.882421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:54.883104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.883393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.883836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.884711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] RBAC: Adding query filter params (interface=public, service_id=6f524dbd794640dbb7c91565f5db3491, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:54.885128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:54.886703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b7a59-2078-46b8-936c-315f4042aa69 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.895469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 395/774] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:43:54 2022] GET /identity/v3/endpoints?service_id=6f524dbd794640dbb7c91565f5db3491&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:54.897087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae651d2-acbe-4f94-a51a-c1bbfab6adff None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.897384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae651d2-acbe-4f94-a51a-c1bbfab6adff None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.897690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae651d2-acbe-4f94-a51a-c1bbfab6adff None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.903308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 396/775] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:54.903308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae651d2-acbe-4f94-a51a-c1bbfab6adff None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:54.911218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:54.912839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.913414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.913923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] PATH_INFO: `/v3/services/network` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.914947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:54.917107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-decd1c05-457a-43ca-b651-63d63ffdf2fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:54.934986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:54.936083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:54.936899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:54.939317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 380/776] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:54 2022] GET /identity/v3/services/network => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:54.940464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:54.940754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:54.941037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:54.960532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:54.961805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:54.973977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.014694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.020643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae651d2-acbe-4f94-a51a-c1bbfab6adff None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.041748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 381/777] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:43:55.041748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.080305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.081465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.081970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.082441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.083369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.084954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.093697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 397/778] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:43:54 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:55.094856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.145772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6aff5-ec3f-4eb9-a00c-c3a582f49533 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.185257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.186217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.186363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.186603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.187259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] RBAC: Adding query filter params (name=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:55.187575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.189002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.194796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 382/779] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:55.201116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.217033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e83fc-a8cc-4581-adb9-df1031daf9a1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.217554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.281536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.282400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.282687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.282970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.310763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:55.318736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:55.319847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:55.320680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:55.331166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 398/780] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:55.332161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.375292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05319c7-7be6-4dc0-86b0-12606b5caeee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.388927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.413283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.413966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.414249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.414530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.415659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] RBAC: Adding query filter params (type=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:55.416105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.417539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.429025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 383/781] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:55.430877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.481779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b36525-9652-4ffa-a761-b9500f5a333d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.510852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.533120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.533841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.534129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.534408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.535181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:55.535489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.536884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.543028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20aef-b8c0-4bf4-96d0-2de942015d23 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.554917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 399/782] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:55.560884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.591775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.592484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.592777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.593057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.593912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] RBAC: Adding query filter params (interface=public, service_id=9d7454c04cd444e8b07da6c5dd735ce6, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:55.594230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.595636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.625914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 384/783] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/endpoints?service_id=9d7454c04cd444e8b07da6c5dd735ce6&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:55.639983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.742111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.748503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20eb0a-57c0-4a75-8b2a-2a25ced7f266 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.783016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.784046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.784431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.784800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.795982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.797702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.805638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ffc12-8766-4902-b487-5397b0698385 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:55.815866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:55.816870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:55.817775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:55.817775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:55.817775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:55.817775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:55.821874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 400/784] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:43:55.824332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:55.875754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:55.876454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:55.876741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:55.877023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:55.877758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:55.879172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:55.885975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:55.892745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 385/785] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:55.988164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba7a1-68d2-4ddb-a351-9de52e0fed22 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.045830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.046530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.046817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.047101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.047853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:56.048167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:56.049631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:56.057856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:56.067666 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 401/786] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:43:56.073413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.196984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a918a9-ad54-4752-99ab-932823bfe087 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.232672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.233486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.233796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.234073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.243161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:56.244869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:56.262213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:56.263207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:43:56.264112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:56.268365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 386/787] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:56.269859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.375937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703469-eb20-49ea-ab4f-07538c1a1b29 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.411786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.412592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.412879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.413154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.414044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:56.414356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:56.415945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf83e5-c94b-444e-a68f-bef9148dd848 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:56.439070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 402/788] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:56.440586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.505890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f674e1-4d00-428f-b884-1f954bd227e4 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.506410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:56.506490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f674e1-4d00-428f-b884-1f954bd227e4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.506490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f674e1-4d00-428f-b884-1f954bd227e4 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.508103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 403/789] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:56.513765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061404-3fae-4aad-ac7f-47fd745ad036 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.514068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061404-3fae-4aad-ac7f-47fd745ad036 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.514338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061404-3fae-4aad-ac7f-47fd745ad036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.532191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6d061404-3fae-4aad-ac7f-47fd745ad036 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:56.533419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6d061404-3fae-4aad-ac7f-47fd745ad036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:56.558425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ec625-37ab-44dd-9ab0-550708322d46 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.603044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.604036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.604539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:56.604647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.604933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.616234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 404/790] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:43:56.617683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c9e90-7025-406c-a9a1-e1c7868d7125 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.618041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c9e90-7025-406c-a9a1-e1c7868d7125 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.618322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c9e90-7025-406c-a9a1-e1c7868d7125 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.619870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:56.619983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 405/791] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:56.625483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:56.626370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.626673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.627024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.643976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:56.645246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:56.645526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:56.646390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:56.647243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:56.647243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:56.647243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:56.647243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:56.647243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 387/792] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:56.653407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.733978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 406/793] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:43:56.735309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.776623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d117-fadb-4fd0-9b5d-3c4724a78a63 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.792844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:56.816010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.816694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.816983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.817263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.818095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:56.818713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:56.819796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:56.837779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 388/794] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:56.839148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.872878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee15118-913b-4e82-b91e-1ebf64ef9242 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.892330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:56.912634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.913837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.914376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.914991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.926673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:56.935285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:56.936198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:43:56.937022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:56.944395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 407/795] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:56.945485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:56.950470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48178f-160c-46c5-9b26-70b036628a95 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:56.985681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:56.986529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:56.986820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:56.987097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:56.998510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:43:57.006581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:57.008356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:43:57.010071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:57.012933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 389/796] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:57.013913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.047190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.071680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a2c5-53e7-4df0-b6bc-4913fb041e7e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.109209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.110628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.111105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.111616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.119751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.119988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1bac-d8d4-4ef9-8fc2-a8b2bc7e5068 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.121869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:57.138958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:57.139942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:57.140814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:57.143438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 408/797] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:57.144449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.162339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.163773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.164546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.165128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.166390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:57.167333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.169475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.186474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 390/798] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:57.187031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.195136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.279672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf1255-20f4-45a6-bbe8-06c498a7e17e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.319310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.324431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.325279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.325574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.325896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.326997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:57.327314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.328985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.330069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e88c8-8cde-446d-9715-92200fcec9ca None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.341781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 409/799] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:57.342655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.376592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.377624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.377924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.378197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.379215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:57.379530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.381767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.398598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 391/800] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:57.399918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.471716 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.475681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f68522-d838-4606-bb49-6ef8d3c90e6e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.512748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.513687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.514037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.514431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.521431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790169-fd6b-4fee-a369-b64049ac7162 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.525911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.527470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:57.545613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:57.546542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:57.547744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:57.547744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:57.547744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:57.547744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:57.551694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 410/801] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:57.552563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.563635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.564840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.565300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.565804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.577361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.579221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:57.599114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:57.600081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:57.600977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:57.600977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:57.600977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:57.600977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:57.609111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 392/802] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:57.610164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.620696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.675868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461313c-ed0e-42ad-86ba-73605aebc0b2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.711965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.712866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.713145 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.713421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/d2cc01f5555e4fdea9b883ab08c31acc/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.715411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=d2cc01f5555e4fdea9b883ab08c31acc, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.716873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.725912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba18b0b-5a67-4c37-8859-51a0abe7c81c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.732824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 411/803] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:57 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/d2cc01f5555e4fdea9b883ab08c31acc/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:43:57.733683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.747913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.782857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.786449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.787108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.788316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.789487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:57.790798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.793537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2463f92-a0db-41b4-a020-fc552dfd8773 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.812236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 393/804] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:57.814894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894dfbf-bb35-4ecd-a326-a033653bdd7a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.815495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894dfbf-bb35-4ecd-a326-a033653bdd7a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.816180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894dfbf-bb35-4ecd-a326-a033653bdd7a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.822895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 394/805] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:57.824537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894dfbf-bb35-4ecd-a326-a033653bdd7a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:57.872533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a3ec7-2134-40cb-a3c2-be5cbc666070 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:57.911877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:57.912567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.912855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.913133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.913913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:57.914220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:57.915755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ae4b1-fa28-4306-be7c-a69e4e91457e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:57.922260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:57.933839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 412/806] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:57.935601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:57.936223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:57.936730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:57.956328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:57.958650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:57.962189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894dfbf-bb35-4ecd-a326-a033653bdd7a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.002688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.003584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.003869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.004143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.012857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.014394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:58.029783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:58.030819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:43:58.031739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:58.032252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 395/807] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:43:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:58.033040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.049472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.057418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 413/808] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:43:58.058694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.167696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154519da-8343-40c5-985e-e6ede3d98d8a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.178689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78a6df-4dce-4ea7-90c1-59cb6104f7f1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.195194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.206032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.206805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.207083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.207353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.215272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.216750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.218161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.219075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.219606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.220138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.221237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:58.221784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.223543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:43:58.233012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:58.234031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:58.235044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 396/809] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:58.235622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.248572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 414/810] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:58.249952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.315862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.352085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf481b7-0aed-4d9f-8dd9-7ed5651e675d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.364838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b298029-81f6-4ba4-a2af-abb6dd4a801b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.391025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.392388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.392754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.393232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.394105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.396026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.403865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.404511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.404791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.405062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.405950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:58.406259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.407697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba43373-8012-4e10-9060-10e9e447d560 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:58.411457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:58.412534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:43:58.413545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:58.420235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 397/811] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:58.420235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.427424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 415/812] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:58.429525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480b80d-ead6-401c-baf2-66e027b7cc30 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.430043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480b80d-ead6-401c-baf2-66e027b7cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.430588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480b80d-ead6-401c-baf2-66e027b7cc30 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.432611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 416/813] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:58.434022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480b80d-ead6-401c-baf2-66e027b7cc30 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.473973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.530852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fcc12-69c7-4027-a31a-a1c902fbaa11 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.555187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480b80d-ead6-401c-baf2-66e027b7cc30 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.573548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1379-4468-4b7f-86fd-ba284aa28dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.574517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1379-4468-4b7f-86fd-ba284aa28dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.574806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1379-4468-4b7f-86fd-ba284aa28dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.575089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1379-4468-4b7f-86fd-ba284aa28dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.576320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.594816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.595506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.595787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.596067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.596823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:58.597174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.598554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.606224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 417/814] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:58.606805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.663506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c1379-4468-4b7f-86fd-ba284aa28dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.663506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c1379-4468-4b7f-86fd-ba284aa28dc2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.719790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.733554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446b9f4-72a2-4fe4-b735-2a85c13a7f79 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.770025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.770837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.771125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.771400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.775118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 398/815] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:43:58.776601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.777052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.777463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.784056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.785670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.795195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:58.796401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:58.804617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:58.806201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:58.807128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:58.807128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:58.807128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:58.807128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:58.809896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 418/816] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:58.810609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.844245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.873162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 399/817] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:43:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:43:58.873970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:58.936290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318af896-11ec-4ee6-adf4-e157b40cf266 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.962763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:58.978434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:58.979113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:58.979395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:58.979672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:58.980401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:58.980706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:58.982133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:58.983931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738175a-3c43-48fd-9caa-1bf38ae4765e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:58.992110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 419/818] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:58.992110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.021700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.022520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.022809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.023090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.035035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.036515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:43:59.054461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:59.055459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:59.057007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:43:59.057007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:43:59.057007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:43:59.057007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:59.062076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 400/819] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:59.062076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.101026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.108500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a9534-9211-4c65-b048-ac38e16da75c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.144427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.145100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.145383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.145694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.146435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:59.146748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.148142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.164516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 420/820] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:59.164516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.175071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e58f-4ab2-4a50-b688-758c9f378477 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.209764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.216633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.217450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.217772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.218054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] PATH_INFO: `/v3/services/network` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.218725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.220125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:59.233146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:59.234242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:43:59.235089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 401/821] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:59.235858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.276527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3228b6-2514-420a-944b-aa2498c2ea25 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.314700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.315462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.315814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.316163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.316993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.318487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.344382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 421/822] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:43:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:43:59.345117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.365354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.376468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c3ee8-c5fb-4942-a48c-25e91f710357 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.437394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.438459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.438932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.439365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.440367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:59.440834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.443322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.465720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 402/823] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:59.465720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.484971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f1a63-0cb1-41a5-89a0-d5e352aa2f79 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.538765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.539608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.540063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.540350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.542065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.550621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.552172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:59.569238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:59.570792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 422/824] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:59.571755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.615174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfaeb-8378-4897-aaba-d2ae195027cf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.661561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.662552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.663012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.663745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.664159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.665262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] RBAC: Adding query filter params (name=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:59.665683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.667384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.678719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 403/825] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:59.678719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.702770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbd438-4ca6-4ca9-96cd-a51440cb4c02 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.745739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.746943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.747394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.747816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.756575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.759186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:43:59.777572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:43:59.778571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:43:59.779469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 423/826] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:43:59.780546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.825279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04050fe-da9c-4286-aeeb-a1aef0b85f46 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.843542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.862619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.863438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.863998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.864235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.865441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:59.865840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.867429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.880549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 404/827] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:59.881282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:59.904665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37a7da-9e0c-4008-9449-483101b71f9e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:59.938533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:59.949627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:59.950957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.951537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.951953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.952836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] RBAC: Adding query filter params (type=network) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:43:59.953321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:59.958728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988a28-b679-4363-a8a0-ef984b4667ed None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:59.975617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 424/828] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:43:59.975617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551fb9b-b5ce-404a-8035-d993810d0a55 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:59.975617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551fb9b-b5ce-404a-8035-d993810d0a55 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:59.975617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551fb9b-b5ce-404a-8035-d993810d0a55 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:59.975617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 425/829] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:43:59.975617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551fb9b-b5ce-404a-8035-d993810d0a55 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:00.110838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551fb9b-b5ce-404a-8035-d993810d0a55 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:00.149643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:00.150798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.151171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.151547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/60818dbaf4ec4ec998f93a603bafa773/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.156843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aba36-d697-46ed-bbd2-7fadb6a5137b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:00.170102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=60818dbaf4ec4ec998f93a603bafa773, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:00.171601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:00.187919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 426/830] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:43:59 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/60818dbaf4ec4ec998f93a603bafa773/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:00.188962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:00.214049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:00.215264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.215535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.215865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.216872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:00.217247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:00.218976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966595fb-4527-4575-9c71-f5879f062fc6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:00.235669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 405/831] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:00.237418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.238107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.238413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.266998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:00.269362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:00.269741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.315199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.357534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999558a3-62fa-4073-b5b7-8f8e4b7213a3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:00.370388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 406/832] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:00.371392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:00.401336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb074-55b1-4935-8601-288efca04154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:00.402122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb074-55b1-4935-8601-288efca04154 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.402410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb074-55b1-4935-8601-288efca04154 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.402690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb074-55b1-4935-8601-288efca04154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.403454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fb074-55b1-4935-8601-288efca04154 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:00.404852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fb074-55b1-4935-8601-288efca04154 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:00.428072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 427/833] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:00.429252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb074-55b1-4935-8601-288efca04154 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:00.517324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a98568-e82a-4a0c-8163-f5f2679ed009 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:00.578014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.582289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:00.582979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.583305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.583626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.584468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=7d5dafc333e54d20aebe2929e1f8a4d4) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:00.584783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:00.586654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:00.590889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb074-55b1-4935-8601-288efca04154 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:00.602968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 407/834] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:00 2022] GET /identity/v3/role_assignments?user.id=7d5dafc333e54d20aebe2929e1f8a4d4&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:00.637875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:00.639140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.639649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.639932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.653321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:00.661251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:00.662302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:00.663112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:00.668106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 428/835] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:00.669679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:00.703050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.789144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36630f0-0d2d-4508-bf42-2e8a888db01f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:00.828089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:00.828832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:00.829123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:00.829405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:00.830212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:00.830528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:00.832081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:00.847718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 408/836] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:00.849182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:00.974840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0eea3-d88e-46fe-8567-ea5f8e6a6905 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:01.013063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:01.014299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.014784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.015269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.028519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:01.030346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:01.048747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:01.049774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:01.050661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:01.050661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:01.050661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:01.050661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:01.053137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 429/837] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:01.059297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:01.152533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.167493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd0756-98de-4e58-9454-b1c044f08f09 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:01.203588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:01.204623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.205065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.205487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.206436 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:01.206888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:01.208478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:01.222375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 409/838] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:01.232274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:01.246644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.344940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcfa9c-2f73-48cd-9bc4-d4c0adc82188 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:01.382381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:01.383459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.384048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.384469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.393430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:01.395065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:01.410576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:01.411794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:44:01.412950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:01.414949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 430/839] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:44:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:01.420725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:01.544075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b4bfa-29b2-49cb-a52e-b8af4a4d5c8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:01.583927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:01.585313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.585805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.586227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.587288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:01.587748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:01.589733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db16e7-48a7-407b-9898-8e4e3c1abd68 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:01.610666 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 410/840] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Jun 23 11:44:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:01.616718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:01.674162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea857-285b-4ec7-8a3d-4954bdaed852 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.674450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea857-285b-4ec7-8a3d-4954bdaed852 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.674731 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea857-285b-4ec7-8a3d-4954bdaed852 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.676418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 411/841] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:01.682296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.682578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.682861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.689700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.697315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.705959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:01.707380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:01.748683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6601c4-3926-4310-ae1b-9d4300f9004e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:01.784263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:01.784930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.785214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.785495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.794042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 412/842] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:01.814243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:01.865812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:01.868536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:01.933546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900359-8b9a-4642-b57b-e76ef2c57e44 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:01.947160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.977375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:01.978866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:01.979390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:01.979851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:01.980720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:01.982619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:01.986333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:01.999955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:02.001020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:02.001913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:02.005857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 413/843] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:02.009661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 431/844] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:44:02.018058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.019358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.131971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369a45-cd4c-437c-a67e-e7edff4be545 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.172375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.173219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.173515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.173804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.183888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e451fc1-6f4d-4fa2-9874-0fa33e6ad002 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.188121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:02.190616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:02.212705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:02.214375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:02.215841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:02.215841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:02.215841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:02.215841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:02.219280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 414/845] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:02.220851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.251592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.252927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.253473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.254025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.255780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:02.256753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:02.259877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:02.266584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 432/846] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:02.277064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.295981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:02.337650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:02.361969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba00afe-f2e2-413d-891a-288bf58e07db None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.406793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.407391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.407675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.407955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.408743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:02.409801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:02.412370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:02.442158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 415/847] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:02.447368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.457350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827534b-5865-4101-a4bb-ddb55c29213b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.507457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.508765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.509270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.510031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.511646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:02.512697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:02.516627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d97586-b0ca-4b8f-a797-ff5ab1304e63 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:02.526804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 433/848] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:02.605294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ce22e-739a-4e0a-a30e-795daeefba7d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.606223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ce22e-739a-4e0a-a30e-795daeefba7d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.606932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ce22e-739a-4e0a-a30e-795daeefba7d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.610947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 434/849] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:02.616899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.617557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.617557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.636532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:02.637822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:02.665633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fb750-fc22-4a08-8299-84999e88fbb6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.694746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:02.736525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 435/850] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:02.746665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.748777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.748777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.749096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.762768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:02.764633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.765398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:02.788001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:02.788947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:02.789992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:02.792574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 416/851] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:02.803624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.806392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:02.907503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7f7a0-2a23-4380-98bf-5bf0f54f8ce4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.925378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e9b89-800d-4f1e-b4c0-7bcfe7d74787 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:02.964809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.965555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.965879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.966199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.967019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:02.967334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:02.968289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:02.969299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:02.970622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:02.971334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:02.971816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:02.988745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 417/852] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:02.990821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:02.992482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:03.008018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:03.009848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:44:03.011349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:03.021857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 436/853] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:03.024957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.029097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:03.109052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee06a1-9f74-469b-83f2-67040f8e4f6b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.139695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:03.149482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.150387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.150681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.150963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.151835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=d2cc01f5555e4fdea9b883ab08c31acc) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:03.152152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.153679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f22a60-d49a-4b95-9b68-d76206b7586f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.157394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1f79-8fb1-4441-b84e-332a4e38d17a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.165886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 418/854] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:02 2022] GET /identity/v3/role_assignments?user.id=d2cc01f5555e4fdea9b883ab08c31acc&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:03.173590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c676a0e-6e16-424f-aa3d-51e091c0654c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.173942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c676a0e-6e16-424f-aa3d-51e091c0654c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.174191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c676a0e-6e16-424f-aa3d-51e091c0654c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.177283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 419/855] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:03.182991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.183334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.183563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.209107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:03.211041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:03.211502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.212480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.212988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.213475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.214558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:03.215088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.216723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.233760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 437/856] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:03.235423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.318117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 420/857] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:03.336700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.370993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90253-c329-480f-b98a-c61674e830b9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.376449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:03.412351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.413182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.413468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.413790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.430941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.432418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:03.456322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:03.457296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:03.458896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:03.458896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:03.458896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:03.458896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:03.458896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 438/858] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:03.468259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.472319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:03.511252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556a9c-2982-432d-97ad-bf8ad68f9aa6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.575755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.577046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.577521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.577997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.579132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.581534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.600578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fd461-535f-40aa-be84-5d93de7713e7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:03.605025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:03.606012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:03.606821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 421/859] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:03.613784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.646757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.647560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.647945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.648323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.649237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:03.649702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.651333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.670870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 439/860] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:03.672253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.740770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:03.777109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:03.792327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a1dd-8670-4f01-9582-ed6c753e354d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.796679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33917356-f3ca-4388-99c4-896db57f717a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:03.841408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.842603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.843042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.843532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.851704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:03.853100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:03.853789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:03.854268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:03.855504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:03.855740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.856009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:03.858421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.858573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:03.867987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 422/861] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:03.874730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:03.879829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:03.881076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:03.883592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:03.889649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 440/862] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:03.891222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:04.013942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f516e-4404-4f32-8afe-d4b9c3f91411 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:04.055601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feff11-8fb3-4752-8093-18ccf7de5874 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:04.058762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:04.059528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:04.059876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:04.060216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:04.061105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:04.061386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:04.062894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:04.077976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 423/863] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:04.103903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:04.127802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:04.128978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:04.129470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:04.130005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:04.131418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:04.131942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:04.134550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:04.164907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 441/864] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 23 11:44:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:04.170964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:04.195454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:04.334227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f025e08-74e4-4cee-b3f0-24bffa3966f6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:04.382816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:04.384391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:04.385165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:04.385982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:04.503953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:04.505910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:04.533628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:04.622926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 424/865] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:04.628776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:04.756505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3da5-2db9-4b20-950d-27eae9dff21e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:04.794925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:04.795788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:04.796075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:04.796347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:04.809221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:04.810725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:04.831217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:04.832178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:04.833050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:04.833050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:04.833050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:04.833050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:04.833050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 442/866] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:04.840422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:04.975724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c47ec-5340-45f8-a68a-6c71f5f5f14f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:04.996284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:05.030288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.031322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.031755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.032189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.033369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:05.033873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.036214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112ec5-d315-480f-bce1-101f41456eb4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.051241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 425/867] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:05.057152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.092918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:05.145834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb92a-ca45-43be-a82c-c58e5bd65f7c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.146114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb92a-ca45-43be-a82c-c58e5bd65f7c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.146395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb92a-ca45-43be-a82c-c58e5bd65f7c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.148168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 426/868] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:05.153921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.154215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.154498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.172354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:05.173575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:05.209747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d1d44-6de5-4e90-af97-eb8e9d848245 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.255008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.256482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.256957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.257420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.270027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.271653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.285773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 427/869] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:05.291142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:05.292293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:05.293223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:05.293697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 443/870] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:05.300151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.318208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.460325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca75c2-6488-4c08-825e-ef292496d534 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.487731 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:05.526546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.527367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.527647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.527917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.528730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:05.529035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.531111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.556126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 428/871] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:05.568236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.573804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:05.589069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df89343-7cb3-4ff7-bd23-763a0312eab1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.636635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57974a17-6f72-485e-9208-d3bba55b5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.637333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57974a17-6f72-485e-9208-d3bba55b5cc4 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.637642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57974a17-6f72-485e-9208-d3bba55b5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.637930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57974a17-6f72-485e-9208-d3bba55b5cc4 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.638680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57974a17-6f72-485e-9208-d3bba55b5cc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.640107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57974a17-6f72-485e-9208-d3bba55b5cc4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.660502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 444/872] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/services => generated 251 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:05.662210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6a0fa-bc8d-4e63-8513-9e3ccbd106aa None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.662547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6a0fa-bc8d-4e63-8513-9e3ccbd106aa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.662784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6a0fa-bc8d-4e63-8513-9e3ccbd106aa None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.672325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 445/873] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:05.674729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.675207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.675646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.705306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:05.707371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:05.755434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e303c3-fafe-4eda-8f7f-95739273783d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.814989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.816063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.816549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.816654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 446/874] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:05.817448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.818531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=60818dbaf4ec4ec998f93a603bafa773) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:05.819153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.821039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.829228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 429/875] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:05 2022] GET /identity/v3/role_assignments?user.id=60818dbaf4ec4ec998f93a603bafa773&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:05.861152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.011518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:06.036552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a96ea-7514-4311-a22b-31e53975bc9a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.085699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.086642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.087723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.087723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.088180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.089458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:06.109268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:06.110569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:06.111473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:06.112282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 447/876] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:06.120583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.168822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:06.283711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091b17-62b0-4549-b69f-856d17d957ba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.322335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.323030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.323318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.323599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.324331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:06.324643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.326125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235453ff-5de0-41a2-8641-aa4fe0e5503a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.331963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 430/877] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:06.337497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.430640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51837d7-5271-4678-a6ed-b14ef400ac19 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.431070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51837d7-5271-4678-a6ed-b14ef400ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.431555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51837d7-5271-4678-a6ed-b14ef400ac19 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.434254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 431/878] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:06.439313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456cad0-0055-4beb-a35f-f733335e8d4e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.439604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456cad0-0055-4beb-a35f-f733335e8d4e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.439890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456cad0-0055-4beb-a35f-f733335e8d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.461213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3456cad0-0055-4beb-a35f-f733335e8d4e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:06.463319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3456cad0-0055-4beb-a35f-f733335e8d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:06.465533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca2a3b-bc48-4e80-9931-1a6c131927e5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.523825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.524990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.525463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.526291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.527523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:06.528015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.530568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.552934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 448/879] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:06.590135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 432/880] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:06.638459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.663621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:06.787373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb903-9a27-4034-aef4-04fdab72eb40 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.834660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc351fa-0aeb-4190-9197-94f08d4daa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.835559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc351fa-0aeb-4190-9197-94f08d4daa77 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.835661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc351fa-0aeb-4190-9197-94f08d4daa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.835987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc351fa-0aeb-4190-9197-94f08d4daa77 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.836700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc351fa-0aeb-4190-9197-94f08d4daa77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.838629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc351fa-0aeb-4190-9197-94f08d4daa77 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.861487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 449/881] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:06 2022] POST /identity/v3/services => generated 269 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:08.029648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ef04-c36d-4712-894b-9bbb50dc73e9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.030224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ef04-c36d-4712-894b-9bbb50dc73e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.030224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ef04-c36d-4712-894b-9bbb50dc73e9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.032014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 433/882] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:08.038217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a69d4f-0d59-4d01-a994-a5a6f0bf7bf5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.039265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a69d4f-0d59-4d01-a994-a5a6f0bf7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.039795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a69d4f-0d59-4d01-a994-a5a6f0bf7bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.060387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a2a69d4f-0d59-4d01-a994-a5a6f0bf7bf5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:08.062927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a2a69d4f-0d59-4d01-a994-a5a6f0bf7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:08.176958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:08.193504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 450/883] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:08.230077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ef04-c36d-4712-894b-9bbb50dc73e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:08.271288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:08.382705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ef04-c36d-4712-894b-9bbb50dc73e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:08.421084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450e98-ace6-4eaa-8d57-9f58cefa7248 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.421937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450e98-ace6-4eaa-8d57-9f58cefa7248 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.422521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450e98-ace6-4eaa-8d57-9f58cefa7248 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.423976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:08.424813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 451/884] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:08.424919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.429380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.429380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.429380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:08.429380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:08.431510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.432045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.432530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:08.443457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:08.444525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:08.445343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 434/885] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:08.453644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:08.459348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:08.460871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:08.557964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 452/886] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:08.574029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:08.591943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:08.601799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162693bf-b2c6-474d-a1df-4f454d132739 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:08.662636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:08.664219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.665207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.666306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.668068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:08.669163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:08.672305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:08.683386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 435/887] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:08.693537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:08.718943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f2f99-e7dd-472c-904a-75c4b391de12 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:08.748889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:08.759161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:08.759660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.759946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.760226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.773370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:08.782136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:08.783830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:08.785384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:08.788577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 453/888] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 23 11:44:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:08.789919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:08.871915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fe74a-1e74-439c-bdaa-acac62df4dec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:08.906939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6395869-3660-4e15-a55b-5cc16a553592 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:08.911327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:08.912409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.912972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.913475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.914475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:08.915689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:08.917339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffe0c6-1be2-4a6a-b480-e2a9cc6bc880 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:08.923339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 436/889] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:08.925058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020b966-7913-453b-bdca-795c52101ab8 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.925569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020b966-7913-453b-bdca-795c52101ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.926071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020b966-7913-453b-bdca-795c52101ab8 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.927828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 437/890] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:08.933395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020b966-7913-453b-bdca-795c52101ab8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:08.953243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:08.954029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:08.954143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.954656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.955097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:08.956414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:08.957063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:08.959711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846099-f21b-4648-8b7d-bfcb41f001a2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:08.982450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 454/891] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:44:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:08.983906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:08.984206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:08.984492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.004540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:09.005950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:09.057799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:09.086753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 455/892] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:09.087990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.108646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020b966-7913-453b-bdca-795c52101ab8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.150203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:09.150881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.151170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.151451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.152262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] RBAC: Adding query filter params (interface=public, service_id=7aeba5b12e7b434f9e3a6deec405cdd5, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:09.152581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:09.154005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd799c-17aa-4e36-85a1-af9a110488fb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:09.159656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 438/893] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:44:08 2022] GET /identity/v3/endpoints?service_id=7aeba5b12e7b434f9e3a6deec405cdd5&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:09.160969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953583e9-2566-444c-b768-d2f80c9ed7a0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.161247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953583e9-2566-444c-b768-d2f80c9ed7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.161531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953583e9-2566-444c-b768-d2f80c9ed7a0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.162932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 439/894] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:09.165698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953583e9-2566-444c-b768-d2f80c9ed7a0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.229889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38ca4-55ce-4da0-a835-f115c6de6002 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.256360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:09.280668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:09.281498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.281810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.282263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.286057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953583e9-2566-444c-b768-d2f80c9ed7a0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.295600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:09.297115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:09.317420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:09.327169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:09.328839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:09.328839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:09.328839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:09.328839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:09.328839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 456/895] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:09.328839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.331987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26265dc1-8e90-4ed6-b5b5-41e3cd4d821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:09.332680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265dc1-8e90-4ed6-b5b5-41e3cd4d821b None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.333001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265dc1-8e90-4ed6-b5b5-41e3cd4d821b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.333281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26265dc1-8e90-4ed6-b5b5-41e3cd4d821b None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.334079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26265dc1-8e90-4ed6-b5b5-41e3cd4d821b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:09.335501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26265dc1-8e90-4ed6-b5b5-41e3cd4d821b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:09.358808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 440/896] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:09 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:09.361212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.361929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.362434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:09.362915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.388389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:09.389786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:09.487120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 441/897] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:09.488533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c79a-59f6-4d80-be1d-b73525604689 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.489236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.546090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:09.546808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.547097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.547380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.548104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:09.549559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:09.558949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 457/898] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:44:09 2022] GET /identity/v3/services => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:44:09.559149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.625772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:09.701497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329aa71-ed87-44ca-b44e-f39f10dfe3d6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.731918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:09.746006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0ea7d-b97e-4fa0-90a2-5cbc5c2742a4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.757045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:09.757986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.758396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.759289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.760143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:09.760461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:09.761985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:09.775740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 442/899] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:09.781930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.819539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:09.820370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:09.820647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:09.821031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:09.821725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:09.823148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:09.836867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:09.838673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:09.840185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:09.843296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 458/900] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jun 23 11:44:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:09.844680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:09.962621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065813f3-e5bd-4a30-8914-c36331a463f6 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:09.967239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6942241-9690-4918-af85-c6e7d44a9882 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.003082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:10.003270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.003764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.004049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.004336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.005470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:10.005470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.007441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.011985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.013180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.013729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.014208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.018817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 459/901] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:10.020226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:10.024506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.026438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:10.043259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:10.044295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:10.045217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:10.048182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 443/902] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:44:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:10.048879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:10.057360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:10.134018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4379-4916-4d91-b2bc-82dd11e6aed3 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.172129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.172819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.173116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.173395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.174199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:10.174511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.175955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.184201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3668-6ca1-4820-b9d2-960ef9afd4e0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.186853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 460/903] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:10.188724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:10.228358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.229464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.229958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.230422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.231484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:10.232013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.233915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.257913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 444/904] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 23 11:44:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:10.266749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:10.288984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:10.316225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae5ef-2641-46e0-a9a4-a0ccb7759e64 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.343979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:10.382876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.383933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.384065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.384460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.385361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] RBAC: Adding query filter params (interface=public, service_id=5d62b4a900e7449e9c6ce08f7a623883, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:10.385893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.387857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.397756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 461/905] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:44:10 2022] GET /identity/v3/endpoints?service_id=5d62b4a900e7449e9c6ce08f7a623883&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:10.400565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:10.432496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3655-5f26-4d8b-b6cb-5739c5b0e9d3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.509440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.510202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.510612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.511037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.577839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655c8d-1e48-4c52-89d7-3b04c5e2dc78 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.627329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.629681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.643545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.645125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.645676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.646482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.647715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:10.649581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:10.670132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 462/906] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:44:10 2022] GET /identity/v3/services => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:44:10.686302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:10.762877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 445/907] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:44:10.771573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:10.801563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:10.923292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a80e7-5565-45d8-be29-372db11d6268 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:10.977388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:10.978880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:10.979381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:10.979888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:10.998810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:11.000446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:11.023346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:11.024531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:11.026149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:11.026149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:11.026149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:11.026149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:11.026149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 463/908] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:11.033827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:11.163120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77492adb-aa34-4d26-a022-f5ca48ff2eaa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:11.200878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:11.201706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:11.201863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:11.202186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:11.202951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:11.203270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:11.204693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:11.219188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 446/909] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:11.225085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:11.306718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:11.348028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dcd48-bac9-4d00-9fd6-91221a7ce81a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:11.386821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:11.388113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:11.388572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:11.389016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:11.397407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:11.398987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:11.416389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:11.417363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:11.418280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 464/910] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:11.431468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:11.435323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:11.561564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02594-cd37-48b8-8d34-dbade53b761f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:11.598530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:11.599234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:11.599523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:11.599916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:11.600615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:11.600933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:11.602740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cb8b-656e-4551-8a41-2253cd6837a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:11.617056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 447/911] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:11.626821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:11.752302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376a591-009e-48c7-a1d5-fa4244392ced None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:11.782601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:11.783412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af721-09e7-49ea-9684-4c854c81a051 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:11.783611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af721-09e7-49ea-9684-4c854c81a051 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:11.783889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af721-09e7-49ea-9684-4c854c81a051 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:11.785480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 448/912] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:11.792156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:11.792449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:11.792727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:11.793960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:11.794869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:11.795343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:11.795822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:11.796865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] RBAC: Adding query filter params (role.id=f5a894770908473392afd7ba21c3dd58, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=60818dbaf4ec4ec998f93a603bafa773) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:11.797392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:11.799286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:11.806596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 465/913] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:11 2022] GET /identity/v3/role_assignments?user.id=60818dbaf4ec4ec998f93a603bafa773&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=f5a894770908473392afd7ba21c3dd58 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:11.810613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:11.811947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:11.896962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:11.910606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 449/914] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:11.935090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.060512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e958-85f1-4049-bf2b-4c9eba1157b7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.099007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.099759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.100037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.100316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.100999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.102823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3372ed6f-bbe4-4f90-8807-ae384c27b815 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:12.116549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:12.117620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:12.118518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 466/915] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:12.126412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.232009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a5ed3-168c-4971-a69d-1412de1a032e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.232539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a5ed3-168c-4971-a69d-1412de1a032e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.232539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a5ed3-168c-4971-a69d-1412de1a032e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.234267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 467/916] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:12.239762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.240051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.240329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.244456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740debd-e645-47c7-8444-c05e4d62749d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.264726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:12.266622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:12.285399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.287088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.287871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.288626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.290387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:12.291234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.292922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.299490 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 450/917] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:12.305662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.338345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:12.361902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 468/918] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:12.384321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:12.385888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.416324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e43e1-169a-4a9a-bd10-2933f61ef418 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.453539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.454743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.455264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.455743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.456657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:12.457172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.459162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.471253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 451/919] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:12.472545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.499391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0925b-bbc3-488c-a295-401e12210021 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.552712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.553559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.553870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.554146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.554830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.558007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:12.577645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:12.578687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:12.579509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 469/920] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:12.581487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.610758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30a26f-9606-4211-92f5-848beeb73c6e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.635643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:12.653559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.654252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:12.654364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.654550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.654811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.656273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] RBAC: Adding query filter params (interface=public, service_id=e99fafae50ad40c8b4e1448453e9c098, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:12.656672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.658658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.666604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 452/921] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/endpoints?service_id=e99fafae50ad40c8b4e1448453e9c098&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:12.671969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.740029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ad24-6c37-4aca-9e88-354d06bfefb2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.813013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.814764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.815244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.815715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.817279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:12.817822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.820561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.831484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 470/922] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:12.839677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:12.853865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0926b-6649-4a2a-8616-410ab5405a93 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:12.920194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806f68-1a2e-4893-bacc-0d55f8182757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:12.921809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806f68-1a2e-4893-bacc-0d55f8182757 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.922568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806f68-1a2e-4893-bacc-0d55f8182757 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.923287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806f68-1a2e-4893-bacc-0d55f8182757 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.924759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806f68-1a2e-4893-bacc-0d55f8182757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:12.927454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806f68-1a2e-4893-bacc-0d55f8182757 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:12.939648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 453/923] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/services => generated 1497 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:44:12.955541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80618c-6c87-4093-b80a-23a6f9683be9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.955810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80618c-6c87-4093-b80a-23a6f9683be9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.956140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80618c-6c87-4093-b80a-23a6f9683be9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.962038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 454/924] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:12.963890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:12.964232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:12.964575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:12.988049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:12.990896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:13.028527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d78f7-2c2a-405c-b8b3-7d91785c2b89 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:13.053625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:13.082824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:13.095485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:13.096547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:13.097020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:13.097649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:13.098811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:13.099329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:13.101784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:13.112135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 471/925] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Jun 23 11:44:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:13.121750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:13.130239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 455/926] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:13.158319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:13.245161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff97f-cb5d-4566-9860-ae45afccfcb5 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:13.272290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587b893-6c24-48fb-8278-24a0a1d0ad38 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:13.282934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:13.283604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:13.284020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:13.284301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:13.285058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:13.286602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:13.313242 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 472/927] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:44:13.325267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:13.326257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:13.326548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:13.326828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:13.327523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:13.329074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:13.361919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:13.362948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:44:13.363754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:13.365499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 456/928] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Jun 23 11:44:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:13.376519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:13.445348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:13.535966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81ffb-837b-4de3-8dbe-3b14fed0743a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:13.575355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:13.576047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:13.576335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:13.576614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:13.577351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:13.577696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:13.579107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:13.584995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 473/929] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:13.592635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:13.643229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:13.709541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8a45-bc6e-4ea4-a4d9-6de41e705c37 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:13.747634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:13.748325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:13.748613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:13.748897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:13.749654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:13.749972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:13.751512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad850c-4bab-4a65-b34a-3f001950dbe5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:13.757995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 457/930] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:13.764830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:13.873079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:13.879417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d354-137e-4c3e-899c-6ca4d31fcc64 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:13.920585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c22d6-2cf4-45f7-81a7-d1fd94548874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:13.921789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c22d6-2cf4-45f7-81a7-d1fd94548874 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:13.922273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c22d6-2cf4-45f7-81a7-d1fd94548874 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:13.922748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c22d6-2cf4-45f7-81a7-d1fd94548874 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:13.924140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c22d6-2cf4-45f7-81a7-d1fd94548874 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:13.926779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c22d6-2cf4-45f7-81a7-d1fd94548874 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:13.962948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 474/931] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:44:14.054070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7b4c-7396-40f0-a529-e56e5b3df65a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:14.054532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7b4c-7396-40f0-a529-e56e5b3df65a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:14.054820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7b4c-7396-40f0-a529-e56e5b3df65a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:14.057065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 458/932] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:14.063030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:14.063347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:14.063592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:14.083008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:14.084241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:14.188101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 475/933] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:14.211299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a7b4c-7396-40f0-a529-e56e5b3df65a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:14.325230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a7b4c-7396-40f0-a529-e56e5b3df65a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:14.327696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:14.363376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:14.365137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:14.365673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:14.366153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:14.378571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:14.387576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:14.388562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:14.389389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:14.392348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 459/934] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 23 11:44:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:14.398905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:14.496069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:14.521799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceee853-52d4-4bf8-9e94-f7bb748ebedc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:14.570508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:14.571354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:14.571639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:14.571916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:14.572702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:14.573014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:14.574461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:14.584609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 476/935] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:44:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:14.590905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:14.711164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b63e5e-c856-4787-9f48-756ecea619d3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:14.750348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:14.751554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:14.752046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:14.752580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:14.765894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:14.767825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:14.787583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:14.788583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:14.789654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:14.789654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:14.789654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:14.789654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:14.792346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 460/936] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:14.798478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:14.937511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea303-cbf2-4a00-b772-d18ed177d49e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:14.974412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:14.975087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:14.975367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:14.975656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:14.976361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:14.976667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:14.978125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:14.988368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:14.992503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 477/937] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:15.003649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.034864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:15.131676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44d5a3-0d2b-4f5e-b64f-a91a2db7638c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.168053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:15.168887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.169176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.169455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.178158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:15.179637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7a50818e-ba9a-4a2d-a058-1d28b9ccd68a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:15.196026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:15.197138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:15.198277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:15.201903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 461/938] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:15.203701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.255834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e16d-16be-43e3-a937-c8042f7cf5b4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.256195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e16d-16be-43e3-a937-c8042f7cf5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.256597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e16d-16be-43e3-a937-c8042f7cf5b4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.258750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 462/939] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:15.264505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.264809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.265052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.283171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:15.284439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:15.336773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b35d73-046a-4cdd-9c09-72e51f0a0474 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.375856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 463/940] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:15.383847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:15.384544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.384831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.385110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.386281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:15.386602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:15.388093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:15.394719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.405988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:15.411735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 478/941] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:15.420553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.536551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:15.572530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287e7b8-430c-4373-aef1-d6b43efb8e21 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.585064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e010-50f0-49d8-ae2a-dd971c502f30 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.621703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:15.622548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.622831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.623105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.623778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:15.625181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:15.626188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:15.627472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.627948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.628728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-13f252ab-ffaf-40db-863d-3fcf35f81b04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:15.638167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:15.639210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:15.640023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 464/942] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:15.645969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52be77-dd2a-4b58-af63-23ea5f28a7cb None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.646114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52be77-dd2a-4b58-af63-23ea5f28a7cb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.646314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52be77-dd2a-4b58-af63-23ea5f28a7cb None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.646826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:15.647837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 465/943] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:15.648361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:15.648463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52be77-dd2a-4b58-af63-23ea5f28a7cb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-80dac1cd-7928-403f-bd9b-4e03868b8698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:15.671034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:15.672012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:15.672882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:15.672882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:15.672882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:15.672882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:15.672882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 479/944] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:15.674053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.674398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.674737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.693518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:15.694842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:15.733693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:15.773706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 480/945] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:15.773706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.784365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52be77-dd2a-4b58-af63-23ea5f28a7cb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.824638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:15.825264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.825545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.825867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.826603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:15.826915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:15.828336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:15.829743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:15.841590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 466/946] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:15.841590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:15.909775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb708e-ae31-45ba-b896-f074f9e46568 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.948602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:15.949510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:15.950040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:15.950527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:15.951931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:15.952501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:15.955146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:15.962101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af806d7-f9e4-4baa-aee8-4b681605e656 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:15.979687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 481/947] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:15.979687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.011647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.021067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.022240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.022761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.023251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.024635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.027438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.029966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING keystone.server.flask.common [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 11:44:16.057574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 11:44:16.057574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 11:44:16.057574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [parameters: {'id': '42f76af921ea4c3f846f19d38a807089', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 11:44:16.057574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42f76af921ea4c3f846f19d38a807089.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42f76af921ea4c3f846f19d38a807089. Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:44:16.075173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 11:44:16.076150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Jun 23 11:44:16.077321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 11:44:16.078952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 11:44:16.079831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:44:16.080606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': '42f76af921ea4c3f846f19d38a807089', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:16.084582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:16.085458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42f76af921ea4c3f846f19d38a807089. Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 467/948] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Jun 23 11:44:15 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:16.086714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.130301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.134041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825211-a097-4dd9-abe0-4ac8fc07f775 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.173307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.174037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.174322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.174596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.175326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:16.175635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.177590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.188604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 482/949] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:16.188604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.215348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3d437-28cb-45eb-93a5-f8e6c65ef9db None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.258903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.259675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.259963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.260244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.268134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.269891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:16.285442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:16.294789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 468/950] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:16.296521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.315789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88488c1-b6bf-4edd-b136-f7331669e390 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.354903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.355138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.355682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.355951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.356269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.364654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.366189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5c979816-dafe-4516-a060-0d4759004c4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:16.381461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:16.382533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:16.383962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 483/951] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:16.384458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc851-3797-4cd8-ba39-9c2e49f8670a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.384535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc851-3797-4cd8-ba39-9c2e49f8670a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.384778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc851-3797-4cd8-ba39-9c2e49f8670a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.386435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 484/952] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:16.389527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bc851-3797-4cd8-ba39-9c2e49f8670a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.413940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91774235-6b21-44f5-a662-5bb1136bebd8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.416017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.452832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.453503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.453837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.454113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.454875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.456298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.485215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 469/953] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:16.486102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.515589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bc851-3797-4cd8-ba39-9c2e49f8670a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.580037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.581098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.581538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.582016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.583426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:16.583921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.586381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18c3de-ce8f-49ea-a666-173739fdbf1c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.616207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 485/954] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:16.616207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.616207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.616207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.641793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:16.643570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:16.673712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5efbc0-3ea8-4ca0-8791-972001061c5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.677873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.723632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.724793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.725307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.725851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.727416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:16.727982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.730768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.742162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 486/955] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:16.743340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.761524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 470/956] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:16.771182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.772496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.887592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43ecd8-158d-4dd8-bb43-429995d581f7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.928804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.929777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.930108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.930386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/60818dbaf4ec4ec998f93a603bafa773/roles/f5a894770908473392afd7ba21c3dd58` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.932089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef2d38-e0a0-42f0-911b-c990e4036081 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.932692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=60818dbaf4ec4ec998f93a603bafa773, role_id=f5a894770908473392afd7ba21c3dd58)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.934209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.951863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 487/957] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:44:16 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/60818dbaf4ec4ec998f93a603bafa773/roles/f5a894770908473392afd7ba21c3dd58 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:16.981426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.982369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.982702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.982979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.983776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.985206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:17.001193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:17.002399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:17.003265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:17.004630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 471/958] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:17.009840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:17.100908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:17.153250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57008b3-b974-49a4-a324-a2307c594379 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:17.218190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:17.219349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:17.219825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:17.220307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:17.221704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:17.222254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:17.224879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7abf91-d4c1-4508-bb2f-f8f50e5acd87 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:17.234911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 488/959] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:17.243542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:17.287330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:17.424186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ad1d-afbb-4c7d-b338-c9237cfc0d5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:17.483738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:17.484996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:17.485505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:17.486217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:17.487508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:17.488017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:17.490938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29828-3e3c-49b4-a6f6-4b9d155e3bf7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:17.500284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 472/960] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:18.660953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f015e-260b-4555-8614-646137f6456e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:18.661639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f015e-260b-4555-8614-646137f6456e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:18.661639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f015e-260b-4555-8614-646137f6456e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:18.663218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 489/961] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:18.670158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:18.670774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:18.670774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:18.690298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:18.691957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:18.780016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 473/962] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:18.806044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f015e-260b-4555-8614-646137f6456e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:18.942626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f015e-260b-4555-8614-646137f6456e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:18.985735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:18.986734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:18.987020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:18.987295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:18.989620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:18.991024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:18.993111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:19.008634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:19.011457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.017530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 490/963] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:19.025918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.053755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.148996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f50f7-8471-4889-963b-39518c2e09b3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:19.189904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:19.190982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.191476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.191965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.192992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:19.193551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:19.195241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ddd7-9faf-4005-9db2-acb3846e6002 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:19.202091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 474/964] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:19.211228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.224395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7a15-b0b3-40af-80d1-e0a8e8e90397 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.224749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7a15-b0b3-40af-80d1-e0a8e8e90397 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.224938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d7a15-b0b3-40af-80d1-e0a8e8e90397 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.226719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 475/965] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:19.232453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e4b5-b7b1-41bc-9c92-f90a6359594b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.232756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e4b5-b7b1-41bc-9c92-f90a6359594b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.233011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e4b5-b7b1-41bc-9c92-f90a6359594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.251196 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c746e4b5-b7b1-41bc-9c92-f90a6359594b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:19.252401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c746e4b5-b7b1-41bc-9c92-f90a6359594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:19.339681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 476/966] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:19.341432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573d91-328a-4c49-ad70-1e74fa7840ad None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:19.341780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fe660-4926-4beb-b131-1e4cf6e0b43e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.342278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fe660-4926-4beb-b131-1e4cf6e0b43e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.342735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fe660-4926-4beb-b131-1e4cf6e0b43e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.345849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 477/967] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:19.355662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.356041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.356352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.376244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:19.377884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:19.387495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:19.388466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.388921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.389340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.390283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:19.390599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:19.392878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:19.394706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.400072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 491/968] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:19.401069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.485885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 478/969] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:19.485885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.513581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.581388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87d17d-644a-466e-89a3-c50384afa663 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:19.640293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:19.641593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.642008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.642439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.643615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b68f3-1478-4038-aea6-817d34e8b7fd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:19.657386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:19.666969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:19.668408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:19.670168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.673342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 492/970] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:19.674320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.685524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:19.686363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.686749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.687401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.687926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] RBAC: Adding query filter params (interface=admin, service_id=e99fafae50ad40c8b4e1448453e9c098, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:19.688244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:19.689668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:19.695925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 479/971] 10.222.0.27 () {56 vars in 1249 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/endpoints?service_id=e99fafae50ad40c8b4e1448453e9c098&interface=admin®ion_id=RegionOne => generated 193 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:19.701221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.716592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.806446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e3e9-0c8b-43a1-b8b7-40df70785b47 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:19.829305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3674de5-d7f6-4ff9-9f89-33f558e4deb5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:19.831085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.844338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:19.845019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.845375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.845581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.846315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:19.847758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:19.849073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING keystone.server.flask.common [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 11:44:19.863486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.sql.core [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 11:44:19.863486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 11:44:19.863486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [parameters: {'user_id': '51acf9361dae4f08b3fcf91aa8518c66', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 11:44:19.863486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80159) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 11:44:19.868533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:19.869239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.869513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.869843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.870828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:19.871131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result.read() Jun 23 11:44:19.871538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:44:19.873100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application yield resource Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise self.value Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application session.commit() Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 11:44:19.875088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.session.flush() Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application compat.raise_( Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 11:44:19.876186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:44:19.877321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application result.read() Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:44:19.880215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [parameters: {'user_id': '51acf9361dae4f08b3fcf91aa8518c66', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:19.881417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 11:44:19.882550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 11:44:19.884749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 11:44:19.884749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 11:44:19.884749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 11:44:19.884749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 11:44:19.884749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 11:44:19.884749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:19.885659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b288-76a0-46c3-b3b4-0da2818e6b6c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:19.885810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 493/972] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Jun 23 11:44:19 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:19.885810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.887954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 480/973] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:19.889349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4e0f8-05c9-417d-bd48-cd910038a63f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:19.889663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4e0f8-05c9-417d-bd48-cd910038a63f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:19.889949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4e0f8-05c9-417d-bd48-cd910038a63f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:19.893637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 481/974] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:19.893637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4e0f8-05c9-417d-bd48-cd910038a63f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:19.980092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:19.990851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9371cb6-310f-4107-a08e-d79310b3aa3e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.017768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4e0f8-05c9-417d-bd48-cd910038a63f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.030249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.030981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.031260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.031538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.032251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.033904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.044137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 494/975] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:44:20.044860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:20.072341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.073712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.074057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.074343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.084614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.086339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ad6b299c-e14a-4601-b074-b66e90790912 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:20.102999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:20.104416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:20.105357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 482/976] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:44:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:20.106676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.106676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.106676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.116736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:20.126475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:20.127753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:20.186604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56543d0f-cef2-45fc-8496-1d54b499ceb7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.212087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 483/977] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:20.213022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:20.235708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.236524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.236809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.237091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.250668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.252208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:20.271923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:20.278042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:20.279427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:20.279427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:20.279427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:20.279427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:20.279427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 495/978] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:20.279427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:20.304662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:20.356721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970aa32-a787-49f5-aeca-4692216b06f7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.404677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.406012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.406581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.412381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.414022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:20.414594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.417338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.418351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:20.425217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3049b-cc72-472f-8e5c-a50958c6f308 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.473910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 484/979] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Jun 23 11:44:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:20.473910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:20.500621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.502610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.504045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.504732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.506297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.510860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.537415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 496/980] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:20 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:20.631445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453106aa-0fc7-4206-adc6-6e1a7a1961b8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.660499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:20.688613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.689660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.689660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.689932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.690845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:20.691027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.692484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.707236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 485/981] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:20.714194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:20.847165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69965-13f6-4774-a54a-9c4d8c31053f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:20.902068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:20.902807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:20.903095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:20.903377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:20.912698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:20.914349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:20.934255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:20.936225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:20.938552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 497/982] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:44:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:20.941400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:21.073762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c193-2566-49c5-b51a-37732664cb5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:21.118120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:21.118822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:21.119101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:21.119383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:21.120271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:21.120581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:21.122093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:21.142414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 486/983] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Jun 23 11:44:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:21.148084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:21.179062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:21.303511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d06f0-f873-4d43-9466-78c9e73c9a3c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:21.347732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:21.348884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:21.349391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:21.349921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:21.436165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:21.437582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:21.460632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:21.620806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 498/984] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:21 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:21.621041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:21.667275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:21.757340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7006674-625f-433d-8790-db9e982a6e14 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:21.810106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:21.811501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:21.812054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:21.812599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:21.827180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:21.829349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:21.854968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:21.855923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:21.856785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:21.856785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:21.856785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:21.856785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:21.859295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 487/985] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:21.867200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:21.996848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a99891-5216-479f-a53e-3a46f9888362 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.021684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:22.039320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.040359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.040714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.041041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.041782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:22.042096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.043565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.057191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 499/986] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:22.062632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.154231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:22.172203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e706-ff37-4087-9351-a0b06c9a4956 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.219325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.220152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.220444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.220723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.228828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.230340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-77303787-c1aa-440c-9a4b-c6fda4f11d1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:22.253471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:22.254737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:22.256078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:22.258092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 488/987] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:22.262071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.305592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b59d3-13f7-40b4-a638-3574100cab76 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.305890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b59d3-13f7-40b4-a638-3574100cab76 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.306195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b59d3-13f7-40b4-a638-3574100cab76 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.308450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 489/988] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:22.315137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269059e3-225c-4dff-8150-52350e14816f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.315835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269059e3-225c-4dff-8150-52350e14816f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.316111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269059e3-225c-4dff-8150-52350e14816f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.335813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-269059e3-225c-4dff-8150-52350e14816f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:22.337215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-269059e3-225c-4dff-8150-52350e14816f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:22.398260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2790-475c-4caf-805f-e48bcf377657 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.419741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 490/989] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:22.435670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.436345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.436628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.436904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.437726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:22.438037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.439475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.443615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269059e3-225c-4dff-8150-52350e14816f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.452979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 500/990] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:22.458933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.502779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:22.530528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:22.556643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269059e3-225c-4dff-8150-52350e14816f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.569127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432af887-991a-4fe3-bb6a-4d3dc3eab422 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.595813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.596750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.597284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.597417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.598040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.599420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.608937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.609630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.609930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.610208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.611067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] RBAC: Adding query filter params (role.id=f5a894770908473392afd7ba21c3dd58, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=60818dbaf4ec4ec998f93a603bafa773) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:22.611384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.612853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d1931-d705-481b-b400-cf0da723aa78 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:22.613884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:22.615458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:22.616450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 491/991] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:22.622367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.624008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 501/992] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/role_assignments?user.id=60818dbaf4ec4ec998f93a603bafa773&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=f5a894770908473392afd7ba21c3dd58 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:22.707929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06d9c-d7dc-4e93-9d85-0b82106691f7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.708310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06d9c-d7dc-4e93-9d85-0b82106691f7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.708667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06d9c-d7dc-4e93-9d85-0b82106691f7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.710371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 502/993] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:22.716424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.716724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.717007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.735883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:22.737536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:22.743369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8f7e-75fd-496e-bbbb-f23b1aaa3d52 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.782376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.783752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.784033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.784305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.785022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:22.785326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.786770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.792975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 492/994] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:22.799815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.804964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:22.820431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 503/995] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:22.844192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:22.889975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:22.934602 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f9ca-91d3-4f84-955e-17b248b36a08 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.967330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f029579-468b-4e51-97d5-ac93a6bbfe93 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:22.972980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:22.973549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:22.973923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:22.974138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:22.974873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:22.975195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:22.976767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:22.987182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 493/996] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:22.988301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:23.011315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:23.012346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:23.012633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:23.013207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:23.013922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:23.015331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:23.033192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:23.034859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:23.036218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 504/997] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:23.041982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:23.087181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:23.137008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edc77c-65da-4952-8ca4-841b71416cb6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:23.172206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:23.177166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfd6ae-b82c-4da4-93dc-96054197bb40 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:23.182451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:23.183153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:23.183665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:23.184165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:23.185628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:23.188244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:23.205729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 494/998] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:23.228536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:23.229694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:23.230188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:23.230702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:23.231798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:23.232332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:23.234040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:23.240917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 505/999] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:23.247205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:23.377162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054fd2-0e88-4e68-ab3b-9ed06d2bb090 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:23.407430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:23.417228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:23.418106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:23.418399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:23.418704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:23.419407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:23.419721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:23.421154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:23.426764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 495/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:23.433063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:23.540982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635c812-7794-47c7-b3ab-080d18ddf9b7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:23.580171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:23.580841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:23.581126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:23.581405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:23.582248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] RBAC: Adding query filter params (interface=public, service_id=9ea745c040f0464c80023e49ce74139f, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:23.582574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:23.583956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc958b-070b-4345-a97e-23ae305de366 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:23.594832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 506/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:44:23 2022] GET /identity/v3/endpoints?service_id=9ea745c040f0464c80023e49ce74139f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:23.597182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:23.708634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37e6f-cf19-472f-ac06-92a4bd178999 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:23.744343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba7582-0ee8-45e5-82f3-1ed0444abdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:23.745024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba7582-0ee8-45e5-82f3-1ed0444abdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:23.745351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba7582-0ee8-45e5-82f3-1ed0444abdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:23.745616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba7582-0ee8-45e5-82f3-1ed0444abdd1 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:23.746351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba7582-0ee8-45e5-82f3-1ed0444abdd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:23.747823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba7582-0ee8-45e5-82f3-1ed0444abdd1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:23.755130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 496/1002] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:44:23 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:44:24.732277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299d10-3261-42bd-b7ed-6d9ac09e8ea1 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:24.732807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299d10-3261-42bd-b7ed-6d9ac09e8ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:24.732885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299d10-3261-42bd-b7ed-6d9ac09e8ea1 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:24.734333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 507/1003] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:24.740797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:24.741323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:24.741323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:24.759413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:24.760637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:24.815559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:24.837760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 497/1004] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:24.859735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299d10-3261-42bd-b7ed-6d9ac09e8ea1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:24.889772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:24.977345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299d10-3261-42bd-b7ed-6d9ac09e8ea1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:25.014292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:25.015101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.015382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.015656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] PATH_INFO: `/v3/services/image` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.016325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:25.017735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:25.029943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:25.031027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:25.031942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:25.033981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 508/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jun 23 11:44:24 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:25.037244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:25.145012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cdfa2-0ec3-4745-807f-d826c3ffde83 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:25.183882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:25.184570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.184853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.185145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.185915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] RBAC: Adding query filter params (name=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:25.186203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:25.187629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f110f7-6447-44d5-8fba-7eb7357e3d71 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:25.193491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 498/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:25.199913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:25.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142bd63-dffe-4568-babe-4eb3de795bd5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.312705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142bd63-dffe-4568-babe-4eb3de795bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.312824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142bd63-dffe-4568-babe-4eb3de795bd5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.314467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 499/1007] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:25.320127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.320958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.321314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.343495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:25.345859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:25.347115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:25.367760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01eb46-088b-4944-b904-a8cbdf8f616f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:25.412245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:25.412837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.413115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.413393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.414243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:25.414560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:25.415271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:25.415995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:25.422986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 509/1008] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:25.462231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 500/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:25.487176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:25.629970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c582e-28b4-4f0b-8b9e-85f3175944c4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:25.670931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76539df-4b27-4c8a-a685-db945e228a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:25.671789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76539df-4b27-4c8a-a685-db945e228a0b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.672075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76539df-4b27-4c8a-a685-db945e228a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.672347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76539df-4b27-4c8a-a685-db945e228a0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.673637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76539df-4b27-4c8a-a685-db945e228a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:25.675093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76539df-4b27-4c8a-a685-db945e228a0b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:25.676930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 510/1010] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:25.683468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:25.851145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55cc85-3ebd-4b77-9ad4-607be805492b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:25.896027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:25.896498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e85d-26ec-41ea-8f66-e8373a220329 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.896971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.897047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e85d-26ec-41ea-8f66-e8373a220329 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.897116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.897184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e85d-26ec-41ea-8f66-e8373a220329 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.897263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.897994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:25.898879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 511/1011] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:25.899642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:25.906457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:25.906753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:25.907013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:25.928727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:25.930053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:25.937972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 501/1012] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:25 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:25.958150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:26.048256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 512/1013] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:26.073276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:26.121104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:26.221239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333d39a-59b3-4d85-9e51-fbb81bfe5dc0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:26.284665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:26.286125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:26.286651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:26.287159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:26.288457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:26.291235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:26.312277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:26.313334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:26.314694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 502/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:26.321650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:26.478621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247fe3f-ab45-45db-8d57-31a7552825bb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:26.542737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:26.543921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:26.544433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:26.544931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:26.546357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:26.546962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:26.549961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:26.569864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 513/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:26.572861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:26.691257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:26.698771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb00d1-a482-4fb5-8d5c-5914241748c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:26.734756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:26.735344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:26.735685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:26.735948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:26.736696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:26.737117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:26.738427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f44b-a5d5-4673-af5f-151b17d3bddf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:26.745478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 503/1016] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Jun 23 11:44:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:26.751596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:26.767922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:26.896515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d5b2-1a6e-41d8-9fde-3069bb0f5006 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:26.953987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2e98-d700-43a0-8b1e-bd30a8ead1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:26.955194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2e98-d700-43a0-8b1e-bd30a8ead1b8 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:26.955742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2e98-d700-43a0-8b1e-bd30a8ead1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:26.956215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2e98-d700-43a0-8b1e-bd30a8ead1b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:26.957766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2e98-d700-43a0-8b1e-bd30a8ead1b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:26.960326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2e98-d700-43a0-8b1e-bd30a8ead1b8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:26.992275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 514/1017] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:27.664170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3331d3-3a2a-41a6-9639-80c40c554591 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:27.664860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3331d3-3a2a-41a6-9639-80c40c554591 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:27.665381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3331d3-3a2a-41a6-9639-80c40c554591 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:27.668151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 504/1018] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:27.677385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ceaae-432d-4e6d-b284-c39f22ad0861 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:27.677950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ceaae-432d-4e6d-b284-c39f22ad0861 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:27.678469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ceaae-432d-4e6d-b284-c39f22ad0861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:27.707949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-aa9ceaae-432d-4e6d-b284-c39f22ad0861 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:27.710130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-aa9ceaae-432d-4e6d-b284-c39f22ad0861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:27.816577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:27.838481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 515/1019] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:27 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:27.876187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3331d3-3a2a-41a6-9639-80c40c554591 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:27.996927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3331d3-3a2a-41a6-9639-80c40c554591 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:28.034085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fef8c-a27d-4410-ae7d-7f43561bb8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:28.034760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fef8c-a27d-4410-ae7d-7f43561bb8e8 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:28.035047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fef8c-a27d-4410-ae7d-7f43561bb8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:28.035329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fef8c-a27d-4410-ae7d-7f43561bb8e8 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:28.036087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fef8c-a27d-4410-ae7d-7f43561bb8e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:28.037473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fef8c-a27d-4410-ae7d-7f43561bb8e8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:28.054148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 505/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:27 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:28.104519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a937a-79ad-4125-86e8-6c08328e88d9 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:28.105066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a937a-79ad-4125-86e8-6c08328e88d9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:28.105066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a937a-79ad-4125-86e8-6c08328e88d9 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:28.106776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 516/1021] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:28.113201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:28.113814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:28.113814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:28.134401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:28.135549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:28.154133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:28.235913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 506/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:28.261276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a937a-79ad-4125-86e8-6c08328e88d9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:28.376306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a937a-79ad-4125-86e8-6c08328e88d9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:28.413087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e87c-27b8-4c44-87f5-2c5ff753476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:28.413869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e87c-27b8-4c44-87f5-2c5ff753476e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:28.414201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e87c-27b8-4c44-87f5-2c5ff753476e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:28.414478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e87c-27b8-4c44-87f5-2c5ff753476e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:28.415741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e87c-27b8-4c44-87f5-2c5ff753476e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:28.417192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e87c-27b8-4c44-87f5-2c5ff753476e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:28.419083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 517/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:28.424998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:28.539080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630a7f-4dd0-446d-88bc-86d96286e45a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:28.583090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd193df-0762-4c10-ab85-133fc69e2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:28.583789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd193df-0762-4c10-ab85-133fc69e2252 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:28.584082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd193df-0762-4c10-ab85-133fc69e2252 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:28.584361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd193df-0762-4c10-ab85-133fc69e2252 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:28.585104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd193df-0762-4c10-ab85-133fc69e2252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:28.586786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd193df-0762-4c10-ab85-133fc69e2252 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:28.614125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 507/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:44:28 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:29.234945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890b70-e1f1-4bd2-9167-096815d2df6e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:29.235544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890b70-e1f1-4bd2-9167-096815d2df6e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:29.235544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d890b70-e1f1-4bd2-9167-096815d2df6e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:29.237095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 518/1025] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:29.243154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:29.243707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:29.243707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:29.248933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:29.263279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:29.264492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:29.344439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 508/1026] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:29.368706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890b70-e1f1-4bd2-9167-096815d2df6e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:29.440415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:29.482225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d890b70-e1f1-4bd2-9167-096815d2df6e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:29.522422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:29.523257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:29.523703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:29.523995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:29.536060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:29.544480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:29.545450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:29.546320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:29.547567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 519/1027] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 23 11:44:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:29.551808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:29.673631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c729830-e4be-4ae7-b0fb-6f0b42fab018 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:29.708532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:29.716266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:29.716954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:29.717236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:29.717516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:29.718316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:29.718620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:29.720043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:29.730452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 509/1028] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:44:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:29.735979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:29.907049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02c90-71ea-4a0c-be3b-232a3efcd94d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:29.933574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:29.947499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:29.948319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:29.948704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:29.948952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:29.971466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:29.972230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:29.992509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:29.994032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:29.995209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:29.995209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:29.995209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:29.995209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:29.998037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 520/1029] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:29.999871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.121721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea9af2-88ac-4995-9dd7-88a0c25163ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.157807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.158372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.158660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.158931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.159679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:30.159989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.161430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee8ba-05be-42f1-8ef6-24af2cb196c3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:30.175849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 510/1030] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:30.181730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.273355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeefdc0-1f80-4a62-87ec-a0bb481b91ba None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.274610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeefdc0-1f80-4a62-87ec-a0bb481b91ba None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.274610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeefdc0-1f80-4a62-87ec-a0bb481b91ba None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.275825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 511/1031] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:30.283992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.284610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.285077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.302144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e7f44-85cc-484d-860e-e53658e0bb07 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.306921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:30.308142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:30.344703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.345906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.346481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.347031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.356305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.358306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:30.369326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:30.376638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:30.377644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:44:30.378736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:30.392498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 521/1032] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:44:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:30.392498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.406558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 512/1033] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:30.428904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.445439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:30.526882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ea9c-6823-4ac7-9d3d-73d62a9d32d9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.540314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809cc11-e19a-4f0f-b2d1-d19600bdeb16 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.569276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.570017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.570371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.570637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.571481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:30.571812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.573455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:30.582282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.583107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.583388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.583651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.584327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.585744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:30.594894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 522/1034] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:44:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:30.598015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:30.602891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:30.604059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 513/1035] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jun 23 11:44:30 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:30.610268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.611550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.673547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:30.743608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:30.754174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083f82d-43f1-41cc-9e18-643198bb9282 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.760175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbd52-0e14-44f6-83de-1874a948b297 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.802707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.803530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.803828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.804103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.805036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:30.805446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.806880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:30.817577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 514/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:30.817824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be85ba-fc74-45b8-ac4a-c7dbe13f6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.817824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be85ba-fc74-45b8-ac4a-c7dbe13f6572 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.817824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be85ba-fc74-45b8-ac4a-c7dbe13f6572 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.817824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be85ba-fc74-45b8-ac4a-c7dbe13f6572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.818523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:30.904235 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be85ba-fc74-45b8-ac4a-c7dbe13f6572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.905760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be85ba-fc74-45b8-ac4a-c7dbe13f6572 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:30.934287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0601e-3064-40c0-ba87-96e507ad80e9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:30.951257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:30.982176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:30.983298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:30.983798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:30.984292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:30.985636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:30.986208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:30.988839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeef2e-3935-41e5-bd91-4d83725a9587 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.003558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 515/1037] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:31.003558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6200b-ad2f-43f3-baa0-b4a09c891c14 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.003558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6200b-ad2f-43f3-baa0-b4a09c891c14 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.003558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6200b-ad2f-43f3-baa0-b4a09c891c14 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.004888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 516/1038] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:31.006042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6200b-ad2f-43f3-baa0-b4a09c891c14 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.010147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.026344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 523/1039] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:31.028051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.028708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.029107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.057228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:31.059341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:31.131904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6200b-ad2f-43f3-baa0-b4a09c891c14 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.154539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 524/1040] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:31.155678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.174322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.175018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.175308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.175587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.176408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] RBAC: Adding query filter params (interface=public, service_id=953bc1ce81a540508a4877caf18c06e0, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:31.176730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:31.178193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.186194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 517/1041] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/endpoints?service_id=953bc1ce81a540508a4877caf18c06e0&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:31.193411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.253487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.298593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681da227-ed0e-44dd-9500-a3acbf8209dd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.327807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295cd37-3c5a-46ba-a46f-9a12d79b8a18 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.336042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.354747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.355598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.355879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.356156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.369810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:31.371511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.390976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.392123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.392612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:31.392880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:31.394058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:31.394983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:31.394983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:31.394983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:31.394983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:31.395203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.395282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 525/1042] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:31.395351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:31.395427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.397191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.413635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 518/1043] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/services => generated 1957 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:44:31.413635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.556938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0711ff-b1f1-44f4-8bb1-5c31f2cff9cd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.564625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc3c29-5b62-48de-a4eb-80ee9bcbe01f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.569410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.605782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.606602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.606887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.607160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.620074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.621083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.621544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.621990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:31.623113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.623482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:31.623799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:31.625223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:31.629764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:31.630734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:31.631560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:31.633827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 526/1044] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:31.637935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.642147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 519/1045] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:31.648473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.689323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.777165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797e6d1-622d-4bff-9cee-f330d9d94cb9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.792748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c9fc0-dad0-4b24-8c9f-346b0d344d8f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:31.824787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.825398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.825723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.826029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.826804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:31.827124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:31.828543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.839087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 527/1046] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:31.845834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:31.846179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.846658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:31.846954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:31.847229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:31.856735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:31.858331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:31.875762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:31.876861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:31.878116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 520/1047] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:31.883112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:31.914958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.975870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.983962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b371f-057b-4dce-a963-7106eb839fac None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:32.005819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4de2-760a-4008-a1fd-ce26691066ab None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:32.024696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:32.026006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:32.026510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:32.026976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] PATH_INFO: `/v3/users/40ab761ca5ed4fb3b41904641dc3aea0` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:32.048587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:32.049050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] RBAC: Authorizing `identity:get_user(user_id=40ab761ca5ed4fb3b41904641dc3aea0)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:32.049576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:32.050075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:32.050589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:32.050696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:32.051579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:32.052099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:32.060970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 528/1048] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/users/40ab761ca5ed4fb3b41904641dc3aea0 => generated 285 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:32.061179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:32.062701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:32.080488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 521/1049] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:32.081585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:32.178586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5d68-463b-47ab-ba3d-3182a77315b0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:32.183038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:32.201764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df271d-225d-4749-8d47-d7624bc77019 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:32.223089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:32.223702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:32.227869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:32.227869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:32.246539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:32.247321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:32.247613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:32.247880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:32.248830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] RBAC: Adding query filter params (role.id=f5a894770908473392afd7ba21c3dd58, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=7d5dafc333e54d20aebe2929e1f8a4d4) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:32.249150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:32.250652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:32.254696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:32.258984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 522/1050] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:32 2022] GET /identity/v3/role_assignments?user.id=7d5dafc333e54d20aebe2929e1f8a4d4&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=f5a894770908473392afd7ba21c3dd58 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:32.317616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:32.319235 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:32.447313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 529/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:44:32.452945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:32.578736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965d70b-3a3d-4398-b8cd-8b0182d744bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:32.625741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee427-cb52-41ab-a2e7-2f33bf8bb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:32.626633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee427-cb52-41ab-a2e7-2f33bf8bb603 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:32.626916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee427-cb52-41ab-a2e7-2f33bf8bb603 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:32.627192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee427-cb52-41ab-a2e7-2f33bf8bb603 None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:32.628432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ee427-cb52-41ab-a2e7-2f33bf8bb603 None admin] RBAC: Authorizing `identity:get_project(project_id=3e12cf5972064365ade2bc724242a6f7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:32.629966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ee427-cb52-41ab-a2e7-2f33bf8bb603 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:32.632031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 523/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:32 2022] GET /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:32.638386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:32.714011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:32.769938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c19b2d-69c5-42e0-a410-c6547be8dc40 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:32.812074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:32.812741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:32.813020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:32.813328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:32.814156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=3e12cf5972064365ade2bc724242a6f7, user.id=40ab761ca5ed4fb3b41904641dc3aea0) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:32.814466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:32.815918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6bf1e-cde7-4f2e-9c46-b1b65a022197 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:32.823195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 530/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:32 2022] GET /identity/v3/role_assignments?user.id=40ab761ca5ed4fb3b41904641dc3aea0&scope.project.id=3e12cf5972064365ade2bc724242a6f7&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:33.538514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029022e3-4763-421f-ae40-5ede70640704 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:33.539153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029022e3-4763-421f-ae40-5ede70640704 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:33.539153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029022e3-4763-421f-ae40-5ede70640704 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:33.540447 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 524/1054] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:33.546244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:33.546724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:33.546832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:33.570239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:33.571592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:33.649212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 531/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:33.673246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029022e3-4763-421f-ae40-5ede70640704 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:33.694120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:33.784656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029022e3-4763-421f-ae40-5ede70640704 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:33.821006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:33.821822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:33.822086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:33.822368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:33.823032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:33.824426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:33.836771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:33.837848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:44:33.838696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:33.840144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 525/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Jun 23 11:44:33 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:33.844656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:33.914020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:33.973552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21de4-353b-4e9a-9c1d-b38eb6dbc7d3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:34.014885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58510f-d084-413b-be93-7961de04977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:34.015732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58510f-d084-413b-be93-7961de04977a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.016154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58510f-d084-413b-be93-7961de04977a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.016562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58510f-d084-413b-be93-7961de04977a None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.017446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58510f-d084-413b-be93-7961de04977a None admin] RBAC: Adding query filter params (name=image) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:34.017911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58510f-d084-413b-be93-7961de04977a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:34.019432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58510f-d084-413b-be93-7961de04977a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:34.029860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 532/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:34.032181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:34.119433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:34.142946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064a1d-a791-4f09-912c-b0bf107842f9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:34.185029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:34.186137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.186569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.187018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.187882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:34.188337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:34.189903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2cc9b-916e-49e7-bb7a-331f44a74d47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:34.200164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 526/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:34.201814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58510f-d084-413b-be93-7961de04977a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:34.310924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58510f-d084-413b-be93-7961de04977a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:34.316146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca01b4-cf34-42c7-aa90-31318c732abe None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.316435 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca01b4-cf34-42c7-aa90-31318c732abe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.316716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca01b4-cf34-42c7-aa90-31318c732abe None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.320084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 527/1059] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:34.325505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.325880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.326262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.329249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:34.346516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:34.347592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:34.354197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:34.354868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.355147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.355423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.356193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:34.357557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:34.378954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 533/1060] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:44:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:34.438095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 528/1061] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:34.461635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:34.587137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fcbd-3b50-4bfd-99e4-272e1b641886 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:34.634799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:34.635884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.636316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.636765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.648264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:34.657238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:34.658368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:34.659209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:34.660189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 534/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 23 11:44:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:34.666356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:34.741999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:34.779492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599be5-585b-41fb-8dee-41210a04a7f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:34.816658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:34.817348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.817653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.817936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.818695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:34.819008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:34.820546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e670-0883-4635-bc5d-98c87578bf8a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:34.829346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 529/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:44:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:34.834940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:34.879902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:34.909266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e467-0171-4b71-8839-fdc7d0e997a4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.909266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e467-0171-4b71-8839-fdc7d0e997a4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.909266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e467-0171-4b71-8839-fdc7d0e997a4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.909757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 530/1064] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:44:34.915596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:34.915868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:34.916175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:34.934203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:34.935428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:34.973443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d847f-b6fa-41fa-8bf6-0ac5b9561436 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.012192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.013588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.014104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.014607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.015051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 531/1065] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:35.027288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.029110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.038607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:35.049098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:35.050424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:35.051413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:35.051413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:35.051413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:35.051413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:35.052342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 535/1066] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:35.058552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.108017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.152854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef09d9-a2cf-4506-b611-068aeafd3b34 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.158030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.184832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668672-bcfc-4b5b-8711-d1b11a60e9f2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.192789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.193564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.193880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.194157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.205493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:35.213663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:35.214823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:35.215739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:35.218321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 532/1067] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:35.225312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.225728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.226411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.226763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.227042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.227821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:35.228130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.229532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.243000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 536/1068] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:35.249057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.367662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326c19-5071-4646-a32c-1213100d3bfd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.392346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88020b-147f-4431-b3cd-718c2fa312bc None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.393164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.407157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.407830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.408188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.408396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.409132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:35.409437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.410867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.424772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 533/1069] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:35.425912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.437814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37469e8c-d610-4285-a934-399b5616967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.438543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37469e8c-d610-4285-a934-399b5616967c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.439181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37469e8c-d610-4285-a934-399b5616967c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.439465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37469e8c-d610-4285-a934-399b5616967c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.448275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37469e8c-d610-4285-a934-399b5616967c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.449764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37469e8c-d610-4285-a934-399b5616967c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.452892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-37469e8c-d610-4285-a934-399b5616967c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:35.466686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:35.467700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:35.468674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 537/1070] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:35.473940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37469e8c-d610-4285-a934-399b5616967c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.549624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b49c8-63d1-447e-8ea6-2bcf7cadc1e0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.608178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.609449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.610179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.610179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] PATH_INFO: `/v3/users/40ab761ca5ed4fb3b41904641dc3aea0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.612156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] RBAC: Authorizing `identity:get_user(user_id=40ab761ca5ed4fb3b41904641dc3aea0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.613691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.621642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 534/1071] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/users/40ab761ca5ed4fb3b41904641dc3aea0 => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:35.621819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37469e8c-d610-4285-a934-399b5616967c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.622678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.659071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.659736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.660022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.660299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.661133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:35.661443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.662912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.682054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.687301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 538/1072] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:35.688578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.734648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8d7af-aa84-457e-823c-8ab448aca6ee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.751656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.771672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.772639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.772929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.773352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.774882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] RBAC: Authorizing `identity:get_project(project_id=3e12cf5972064365ade2bc724242a6f7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.776547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.778523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 535/1073] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:35.784108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.802336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3da3-304b-4115-8e95-8593a1c671c2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.841043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.842537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.843098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.843661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.855489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.856948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:35.876290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:35.877275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:35.878213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:35.878213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:35.878213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:35.878213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:35.878213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 539/1074] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:35.883510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:35.903163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a50dff-539e-4792-be6f-330cc08bd3fa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:35.924887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.940661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:35.941510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:35.941822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:35.942089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7/users/40ab761ca5ed4fb3b41904641dc3aea0/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:35.944057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e12cf5972064365ade2bc724242a6f7, user_id=40ab761ca5ed4fb3b41904641dc3aea0, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:35.945740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:35.964877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 536/1075] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:44:35 2022] PUT /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7/users/40ab761ca5ed4fb3b41904641dc3aea0/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:36.008631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323a27c-4bf7-42a7-8deb-8d9efea77546 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:36.021971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:36.052176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:36.052721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.053002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.053276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.054057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:36.054365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:36.055885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:36.070261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 540/1076] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:36.076119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:36.197714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91e2de-e4ac-42f0-808b-4df7a45882a9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:36.234824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:36.235640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.235940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.236204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.245048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:36.246708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:36.262282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:36.263239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:36.264229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:36.265713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 537/1077] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:36.269911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:36.376270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feef36-a3e1-42f5-aa10-bee53a74f1cd None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:36.412818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:36.413490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.413871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.414318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.415089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:36.415462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:36.416850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a76f9-da80-4496-985b-69833f6990dd None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:36.435141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 541/1078] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:36.436450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:36.488844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:36.507080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3340-3bbd-49e4-9d0c-71a83785873d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.507379 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3340-3bbd-49e4-9d0c-71a83785873d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.508154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3340-3bbd-49e4-9d0c-71a83785873d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.509729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 542/1079] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:36.516334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.516630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.516897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.534630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:36.535851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:36.559284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eb49a-6577-4c15-8510-b7f924891302 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:36.566215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:36.610431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:36.611348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.611630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.611898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/7d5dafc333e54d20aebe2929e1f8a4d4/roles/f5a894770908473392afd7ba21c3dd58` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.614114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=7d5dafc333e54d20aebe2929e1f8a4d4, role_id=f5a894770908473392afd7ba21c3dd58)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:36.615923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:36.633670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 543/1080] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:36.638835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 538/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:44:36 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/7d5dafc333e54d20aebe2929e1f8a4d4/roles/f5a894770908473392afd7ba21c3dd58 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:36.669255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:36.840474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccad3c-a6c4-48c9-9cb3-1dc01c1fa579 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:36.891673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:36.892327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:36.892611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:36.892884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:36.923789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:36.969083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:36.970587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:37.080201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 544/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:37.086205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:37.194615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:37.198657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155393fa-2069-490e-917d-df81e30b4946 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:37.237095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:37.237929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:37.238210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:37.238485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:37.250106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:37.251585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6945bbc4-ff72-4e93-aad7-57872b1e275a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:37.271570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:37.272663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:37.274288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:37.274288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:37.274288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:37.274288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:37.277974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 539/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:37.284035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:37.347633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:37.391524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636e489-6fbf-4d23-9f0b-2b04a5f1e7ef None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:37.427470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:37.428136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:37.428440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:37.428694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:37.429525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:37.430052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:37.431368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926070a6-0118-41e7-93ab-2dbadba09c80 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:37.443293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 545/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:38.071978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162380-7bf1-4ba6-bc2a-84f5dcf42a72 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.072236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162380-7bf1-4ba6-bc2a-84f5dcf42a72 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.072524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162380-7bf1-4ba6-bc2a-84f5dcf42a72 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.073950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 540/1085] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:38.079321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.079853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.079853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.097207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:38.098424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:38.169422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 546/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:38.193344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162380-7bf1-4ba6-bc2a-84f5dcf42a72 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:38.310035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162380-7bf1-4ba6-bc2a-84f5dcf42a72 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:38.347269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:38.347988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.348274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.348553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.359588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:38.367970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:38.368928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:38.369830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 541/1087] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:38.375632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:38.425534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:38.478891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0d15c-66db-43ce-9117-5acd720b93d6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:38.515310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:38.516025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.516286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.516564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.517334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:38.517653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:38.519047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:38.528522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 547/1088] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:38.534369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:38.551019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:38.645013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51ce4b-e382-43cf-97ff-74278175916a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:38.680176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2b5fa-fa5a-4739-b3c2-3bbfd9e97895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:38.681127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b5fa-fa5a-4739-b3c2-3bbfd9e97895 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.681396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b5fa-fa5a-4739-b3c2-3bbfd9e97895 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.681732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2b5fa-fa5a-4739-b3c2-3bbfd9e97895 None admin] PATH_INFO: `/v3/users/40ab761ca5ed4fb3b41904641dc3aea0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.682946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2b5fa-fa5a-4739-b3c2-3bbfd9e97895 None admin] RBAC: Authorizing `identity:get_user(user_id=40ab761ca5ed4fb3b41904641dc3aea0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:38.684420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2b5fa-fa5a-4739-b3c2-3bbfd9e97895 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:38.686129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 542/1089] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:38 2022] GET /identity/v3/users/40ab761ca5ed4fb3b41904641dc3aea0 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:38.692138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:38.752844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b3ed-1762-451d-b5bb-69095f5b5109 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.753181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b3ed-1762-451d-b5bb-69095f5b5109 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.753422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b3ed-1762-451d-b5bb-69095f5b5109 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.754861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 543/1090] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:38.759784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.760073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.760352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.777133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:38.778358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:38.801902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ead41-34ca-426c-ac00-20b586c6ef93 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:38.816615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:38.839003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:38.839781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:38.840130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:38.840473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:38.847722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 544/1091] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:44:38.872514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:38.885275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:38.911151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:38.912641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:38.972356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ba0d-f752-4ed4-8ca8-c4e0f56be649 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.008643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.009484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.009777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.010048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.016381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 548/1092] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:39.021383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:39.022098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:39.029569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:39.030537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:39.036441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 545/1093] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Jun 23 11:44:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:39.037155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.037237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:39.110790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:39.126440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc081a7-bcc3-40dd-b129-2e4e48541154 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.142661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a849cc-ee4f-459d-9e66-c63865a3914c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.159502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b473f-800d-4bed-afda-95331350e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.160357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b473f-800d-4bed-afda-95331350e676 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.160634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b473f-800d-4bed-afda-95331350e676 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.160911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b473f-800d-4bed-afda-95331350e676 None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.162103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b473f-800d-4bed-afda-95331350e676 None admin] RBAC: Authorizing `identity:get_project(project_id=3e12cf5972064365ade2bc724242a6f7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.163539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b473f-800d-4bed-afda-95331350e676 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.165339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 549/1094] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:39.171528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b473f-800d-4bed-afda-95331350e676 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.177011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.177732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.178024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.178301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.179064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:39.179398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.180916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.193651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 546/1095] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:39.195752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.262703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:39.283243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b473f-800d-4bed-afda-95331350e676 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.300312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350373-af6f-4927-9c89-e40d9086cb66 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.323987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.324653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.324933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.325209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.326157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=3e12cf5972064365ade2bc724242a6f7, user.id=40ab761ca5ed4fb3b41904641dc3aea0) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:39.326467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.327923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.332745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:39.349914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 550/1096] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/role_assignments?user.id=40ab761ca5ed4fb3b41904641dc3aea0&scope.project.id=3e12cf5972064365ade2bc724242a6f7&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:39.350139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.350139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.350139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.350139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.352683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.354220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:39.373418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:39.374467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:39.375331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:39.375331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:39.375331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:39.375331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:39.375331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 547/1097] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:39.380778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.492501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ec91d-60cf-4e7b-82ba-d026a70bcd1e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.529352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.530078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.530365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.530643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.531389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:39.531699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.533272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.546196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 551/1098] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:39.552998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.669631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbe43-6b44-4758-8d29-0ea502446c8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.703574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.704392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.704652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.704923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.712678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.714167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:44:39.728227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:39.729183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:39.730239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 548/1099] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:39.735382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.740118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:39.847589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dbd2-6820-4659-acff-75bc4249d59a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:39.884718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:39.885408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:39.885697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:39.885982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:39.886863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:39.887179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:39.888638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:39.906883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 552/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:39.912647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:39.963004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:40.019671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3143a-122a-489b-b969-7db8844bae81 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:40.058841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:40.059501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:40.059777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:40.060051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:40.130130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:40.131599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:40.179024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:40.235934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 549/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:40.242219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:40.306325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:40.346633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc69ac-6b1c-4b33-9a60-32cd800dcd27 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:40.381258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:40.382115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:40.382408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:40.382682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:40.393107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:40.394614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:44:40.411963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:40.412902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:40.413801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:44:40.413801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:44:40.413801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:44:40.413801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:40.413801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 553/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:40.419243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:40.524044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077244-1dfd-43b1-890f-3860b95a5629 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:40.559955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:40.561073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:40.561351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:40.561647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:40.562393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:40.562696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:40.564114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:40.578609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 550/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:40.586949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:40.694378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629bbc9-fc0a-4519-9816-885b8d42c379 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:40.713159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:40.735401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:40.736200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:40.736481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:40.736757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:40.744166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:40.745625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:44:40.759532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:40.760598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:44:40.761509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 554/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:44:40.766686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:40.771364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:40.872648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc1409-018c-4c7d-814e-2c81a2543030 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:40.909907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:40.910576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:40.910858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:40.911130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:40.911928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:40.912239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:40.913818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e9fca-541b-408d-956b-af344a00a871 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:40.926156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 551/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:40.932787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:41.051303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79f47f-492d-437d-8d16-3f3b56b63301 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:41.086093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:41.086764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:41.087053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:41.087332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:41.088186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] RBAC: Adding query filter params (role.id=f5a894770908473392afd7ba21c3dd58, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=7d5dafc333e54d20aebe2929e1f8a4d4) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:41.088502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:41.089992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bb780-5048-4d4b-b62f-e2265d908073 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:41.096424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 555/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:40 2022] GET /identity/v3/role_assignments?user.id=7d5dafc333e54d20aebe2929e1f8a4d4&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=f5a894770908473392afd7ba21c3dd58 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:41.413615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e5fd-499b-47c7-afaf-3390e6371a98 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:41.414341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e5fd-499b-47c7-afaf-3390e6371a98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:41.414341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9e5fd-499b-47c7-afaf-3390e6371a98 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:41.416146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 552/1107] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:41.421812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:41.422271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:41.422358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:41.440705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:41.441939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:41.473476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:41.518371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 556/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:41.546308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9e5fd-499b-47c7-afaf-3390e6371a98 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:41.620144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:41.660043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9e5fd-499b-47c7-afaf-3390e6371a98 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:41.699641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d83524-4793-4cfe-9034-05ae3d3600f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:41.699641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d83524-4793-4cfe-9034-05ae3d3600f6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:41.699641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d83524-4793-4cfe-9034-05ae3d3600f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:41.699641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d83524-4793-4cfe-9034-05ae3d3600f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:41.700506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d83524-4793-4cfe-9034-05ae3d3600f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:41.702083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d83524-4793-4cfe-9034-05ae3d3600f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:41.703761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 553/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:41.709670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:41.818891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5d2a3-495d-40b2-b67e-cea6ee072a0a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:41.854620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65e3aa-38b5-4595-a8a7-55b9897cfc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:41.855304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65e3aa-38b5-4595-a8a7-55b9897cfc72 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:41.855586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65e3aa-38b5-4595-a8a7-55b9897cfc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:41.855876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65e3aa-38b5-4595-a8a7-55b9897cfc72 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:41.856591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65e3aa-38b5-4595-a8a7-55b9897cfc72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:41.858055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65e3aa-38b5-4595-a8a7-55b9897cfc72 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:41.887367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 557/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:44:41 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:43.982311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57df735-82b8-4fbd-88dc-9d4da4a2c349 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:43.982865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57df735-82b8-4fbd-88dc-9d4da4a2c349 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:43.982865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57df735-82b8-4fbd-88dc-9d4da4a2c349 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:43.984185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 554/1111] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:43.990938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:43.991628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:43.991869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:44.010555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:44.011755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:44.032447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:44.099779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 558/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:44.125024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57df735-82b8-4fbd-88dc-9d4da4a2c349 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:44.245395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57df735-82b8-4fbd-88dc-9d4da4a2c349 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:44.281108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:44.290841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:44.292239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:44.292676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:44.293109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] PATH_INFO: `/v3/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:44.295861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] RBAC: Authorizing `identity:get_role(role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:44.298091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:44.300249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 555/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:44 2022] GET /identity/v3/roles/8206853c3da544e6afa9c839366fd552 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:44.306422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:44.414650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b53fa8-48d1-422c-affa-0e924ee16cbc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:44.450834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:44.451711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:44.451998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:44.452278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] PATH_INFO: `/v3/users/0a1be57024f44123a812244eeb38721f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:44.469573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a1be57024f44123a812244eeb38721f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:44.471626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:44.474008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 559/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:44 2022] GET /identity/v3/users/0a1be57024f44123a812244eeb38721f => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:44.482009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:44.591029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d782d2-b665-49ea-8334-f254296f3d29 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:44.631363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:44.632021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:44.632423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:44.632716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:44.699969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:44.703175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:44.705734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:44.817623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 556/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:44.823980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:44.840203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:44.935847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af712-3683-4971-9161-7f8a89c99ed8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:44.972239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065b949-86fd-4c8f-86db-0bdab000cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:44.973111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065b949-86fd-4c8f-86db-0bdab000cc07 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:44.973390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065b949-86fd-4c8f-86db-0bdab000cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:44.973695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065b949-86fd-4c8f-86db-0bdab000cc07 None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:44.974911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065b949-86fd-4c8f-86db-0bdab000cc07 None admin] RBAC: Authorizing `identity:get_project(project_id=3e12cf5972064365ade2bc724242a6f7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:44.976925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065b949-86fd-4c8f-86db-0bdab000cc07 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:44.978701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 560/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:44 2022] GET /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:44.985204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:45.090521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:45.093629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022a2a-85e8-4e58-9254-88a820c2a973 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:45.131217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:45.131888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:45.132174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:45.132666 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:45.133520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] RBAC: Adding query filter params (role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=3e12cf5972064365ade2bc724242a6f7, user.id=0a1be57024f44123a812244eeb38721f) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:45.133867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:45.135320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af6c09-6257-4aaf-afbe-d9e54e2df16f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:45.141106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 557/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:44 2022] GET /identity/v3/role_assignments?user.id=0a1be57024f44123a812244eeb38721f&scope.project.id=3e12cf5972064365ade2bc724242a6f7&role.id=8206853c3da544e6afa9c839366fd552 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:47.168647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2b30-4c3c-4cec-9aaa-d1bebe6dae99 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:47.169498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2b30-4c3c-4cec-9aaa-d1bebe6dae99 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:47.169498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2b30-4c3c-4cec-9aaa-d1bebe6dae99 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:47.171950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 561/1118] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:47.180383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:47.180828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:47.180921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:47.199823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:47.201021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:47.272363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 558/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:47.294905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2b30-4c3c-4cec-9aaa-d1bebe6dae99 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:47.386061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:47.407867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2b30-4c3c-4cec-9aaa-d1bebe6dae99 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:47.443654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:47.444448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:47.444846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:47.445709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] PATH_INFO: `/v3/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:47.447374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] RBAC: Authorizing `identity:get_role(role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:47.448761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:47.450196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 562/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:47 2022] GET /identity/v3/roles/8206853c3da544e6afa9c839366fd552 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:47.456983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:47.567870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:47.576176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e8368-bccf-4289-8a6b-c36da0940994 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:47.610932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:47.611845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:47.612127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:47.612406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] PATH_INFO: `/v3/users/0a1be57024f44123a812244eeb38721f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:47.614975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] RBAC: Authorizing `identity:get_user(user_id=0a1be57024f44123a812244eeb38721f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:47.615891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:47.617229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 559/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:47 2022] GET /identity/v3/users/0a1be57024f44123a812244eeb38721f => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:47.624257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:47.733005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41557a-87ea-4022-a1d2-c4154e3771b0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:47.772825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95fed-062e-494e-b0ae-6d6d57451653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:47.773856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95fed-062e-494e-b0ae-6d6d57451653 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:47.774141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95fed-062e-494e-b0ae-6d6d57451653 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:47.774416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95fed-062e-494e-b0ae-6d6d57451653 None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:47.775726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95fed-062e-494e-b0ae-6d6d57451653 None admin] RBAC: Authorizing `identity:get_project(project_id=3e12cf5972064365ade2bc724242a6f7)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:47.777210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95fed-062e-494e-b0ae-6d6d57451653 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:47.779038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 563/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:47 2022] GET /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:47.786519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:47.898509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee3248-91e1-4bd6-99e3-b801cc189f35 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:47.933314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b113-b31a-4020-819a-85fb984c6f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:47.934238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b113-b31a-4020-819a-85fb984c6f29 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:47.934521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b113-b31a-4020-819a-85fb984c6f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:47.934792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b113-b31a-4020-819a-85fb984c6f29 None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7/users/0a1be57024f44123a812244eeb38721f/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:47.937181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b113-b31a-4020-819a-85fb984c6f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e12cf5972064365ade2bc724242a6f7, user_id=0a1be57024f44123a812244eeb38721f, role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:47.938665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b113-b31a-4020-819a-85fb984c6f29 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:47.954282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 560/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:44:47 2022] PUT /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7/users/0a1be57024f44123a812244eeb38721f/roles/8206853c3da544e6afa9c839366fd552 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:49.982256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6392-21ad-4285-afde-80df88df3361 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:49.982840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6392-21ad-4285-afde-80df88df3361 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:49.982840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6392-21ad-4285-afde-80df88df3361 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:49.984133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 564/1124] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:49.990575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:49.991253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:49.991478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:50.011671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:50.012883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:50.034668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:50.097359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 561/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:50.129342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6392-21ad-4285-afde-80df88df3361 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:50.149211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:50.256258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6392-21ad-4285-afde-80df88df3361 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:50.295310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:50.296111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:50.296394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:50.296674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] PATH_INFO: `/v3/roles/8206853c3da544e6afa9c839366fd552` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:50.298319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] RBAC: Authorizing `identity:get_role(role_id=8206853c3da544e6afa9c839366fd552)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:50.299714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:50.301148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 565/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:50 2022] GET /identity/v3/roles/8206853c3da544e6afa9c839366fd552 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:50.308158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:50.421269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b27e7f-2bb6-4a3e-b93a-08734d52beaf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:50.457026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:50.457942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:50.458223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:50.458497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] PATH_INFO: `/v3/users/0a1be57024f44123a812244eeb38721f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:50.459785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] RBAC: Authorizing `identity:get_user(user_id=0a1be57024f44123a812244eeb38721f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:50.461280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:50.462942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 562/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:50 2022] GET /identity/v3/users/0a1be57024f44123a812244eeb38721f => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:50.469218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:50.560403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:50.580302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4509-bd61-4bda-bb62-bea1081c597b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:50.618829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:50.619497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:50.619784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:50.620067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:50.703118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:50.704586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:50.795764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:50.815471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 566/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:50.822171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:50.846994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:50.936987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5033b24-f413-4828-a3c8-2e1eaf65887a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:50.976842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358950a-d89d-4316-b78c-5f4a4f4c3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:50.977846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358950a-d89d-4316-b78c-5f4a4f4c3f9a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:50.978154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358950a-d89d-4316-b78c-5f4a4f4c3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:50.978425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358950a-d89d-4316-b78c-5f4a4f4c3f9a None admin] PATH_INFO: `/v3/projects/3e12cf5972064365ade2bc724242a6f7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:50.979736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358950a-d89d-4316-b78c-5f4a4f4c3f9a None admin] RBAC: Authorizing `identity:get_project(project_id=3e12cf5972064365ade2bc724242a6f7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:50.981171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358950a-d89d-4316-b78c-5f4a4f4c3f9a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:50.982921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 563/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:50 2022] GET /identity/v3/projects/3e12cf5972064365ade2bc724242a6f7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:50.989802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:51.118680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336d6a7-17ec-4b37-8b87-6d76687a9579 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:51.159046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:51.159713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:51.160000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:51.160312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:51.161155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] RBAC: Adding query filter params (role.id=8206853c3da544e6afa9c839366fd552, scope.project.id=3e12cf5972064365ade2bc724242a6f7, user.id=0a1be57024f44123a812244eeb38721f) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:51.161474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:51.162980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88204a9c-0615-4779-8608-4763e7c01947 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:51.169206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 567/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:50 2022] GET /identity/v3/role_assignments?user.id=0a1be57024f44123a812244eeb38721f&scope.project.id=3e12cf5972064365ade2bc724242a6f7&role.id=8206853c3da544e6afa9c839366fd552 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:53.197486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2c3a-9688-4141-9b08-7d574793e31f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:53.198424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2c3a-9688-4141-9b08-7d574793e31f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:53.198569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2c3a-9688-4141-9b08-7d574793e31f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:53.200892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 564/1131] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:53.206502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:53.206954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:53.207045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:53.227407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:53.228624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:53.277366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:53.301359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 568/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:53.325948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2c3a-9688-4141-9b08-7d574793e31f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:53.426361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:53.441141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2c3a-9688-4141-9b08-7d574793e31f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:53.478333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df10df-1abf-4ddd-b879-75efb3c5eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:53.479051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df10df-1abf-4ddd-b879-75efb3c5eecf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:53.479332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df10df-1abf-4ddd-b879-75efb3c5eecf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:53.479607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df10df-1abf-4ddd-b879-75efb3c5eecf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:53.480851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df10df-1abf-4ddd-b879-75efb3c5eecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:53.482351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df10df-1abf-4ddd-b879-75efb3c5eecf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:53.483980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 565/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:53.490524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:53.598554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27d45-22ad-40f3-9695-71ee174a7e26 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:53.637780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196bc6-df71-4f6f-a722-6cf785400308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:53.638452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196bc6-df71-4f6f-a722-6cf785400308 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:53.638742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196bc6-df71-4f6f-a722-6cf785400308 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:53.639019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196bc6-df71-4f6f-a722-6cf785400308 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:53.639740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28196bc6-df71-4f6f-a722-6cf785400308 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:53.641198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28196bc6-df71-4f6f-a722-6cf785400308 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:53.671221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 569/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:44:53 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:55.733764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885f1e2-5a16-41de-a547-11df31a73e19 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:55.734611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885f1e2-5a16-41de-a547-11df31a73e19 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:55.734611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885f1e2-5a16-41de-a547-11df31a73e19 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:55.736875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 566/1135] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:55.743387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:55.744086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:55.744227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:55.771159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:55.772875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:55.804740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:55.852302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 570/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:55.877622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885f1e2-5a16-41de-a547-11df31a73e19 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:55.985134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885f1e2-5a16-41de-a547-11df31a73e19 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:56.023387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bea82-398b-4a35-a69d-0854e0608cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:56.024182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bea82-398b-4a35-a69d-0854e0608cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:56.024465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bea82-398b-4a35-a69d-0854e0608cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:56.024739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bea82-398b-4a35-a69d-0854e0608cf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:56.026000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bea82-398b-4a35-a69d-0854e0608cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:56.027453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bea82-398b-4a35-a69d-0854e0608cf2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:56.029097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 567/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:56.038182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:56.150577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd157a4-318d-4217-8123-fef09bfaf73a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:56.184361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873164ff-c2fa-4531-a299-32293d8f18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:56.185033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873164ff-c2fa-4531-a299-32293d8f18a2 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:56.185316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873164ff-c2fa-4531-a299-32293d8f18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:56.185628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873164ff-c2fa-4531-a299-32293d8f18a2 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:56.186344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873164ff-c2fa-4531-a299-32293d8f18a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:56.187803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873164ff-c2fa-4531-a299-32293d8f18a2 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:56.211279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 571/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:44:56 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:58.338525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5ab8e-2e07-45b0-ac6c-7ae372f43db7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:58.339091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5ab8e-2e07-45b0-ac6c-7ae372f43db7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:58.339091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5ab8e-2e07-45b0-ac6c-7ae372f43db7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:58.340495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 568/1139] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:44:58.346928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:58.347628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:58.347846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:58.372839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:58.374076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:58.385376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:58.449152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 572/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:44:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:44:58.477661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5ab8e-2e07-45b0-ac6c-7ae372f43db7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:58.505331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:58.591574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5ab8e-2e07-45b0-ac6c-7ae372f43db7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:58.629910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:58.630718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:58.631002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:58.631282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:58.641994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:44:58.649644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:44:58.650682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:44:58.651664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:44:58.653792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 569/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:44:58.656986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:58.766215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c8a4-1fac-4b66-9efa-064c57836c45 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:58.804578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:58.805257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:58.805544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:58.805852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:58.806611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:58.806923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:58.808308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:58.816713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 573/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:44:58.824113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:58.928366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:58.945085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51555ad-df2e-49db-8014-bf95d83e7526 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:58.980563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:58.981433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:58.981755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:58.982032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] PATH_INFO: `/v3/users/f3e5068d8b214bec845dec916f64d8d4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:58.996762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] RBAC: Authorizing `identity:get_user(user_id=f3e5068d8b214bec845dec916f64d8d4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:58.998262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:58.999966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 570/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:44:58 2022] GET /identity/v3/users/f3e5068d8b214bec845dec916f64d8d4 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:59.006163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:59.019573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:59.131414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6325acb-843f-48ee-b2b1-f0a2d668a71d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:59.168107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:59.168754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:59.169031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:59.169303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:59.240248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:59.241791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:59.251431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:59.356447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 574/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:44:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:44:59.366679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:59.480394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784225-9974-4a5f-ace4-964434ac0089 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:59.521033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1fbac-2722-4bee-8b23-01aa2b17f242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:59.521935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1fbac-2722-4bee-8b23-01aa2b17f242 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:59.522219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1fbac-2722-4bee-8b23-01aa2b17f242 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:59.522494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1fbac-2722-4bee-8b23-01aa2b17f242 None admin] PATH_INFO: `/v3/projects/71b22e4f941b41ff98840b682cb8f0e8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:59.523747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1fbac-2722-4bee-8b23-01aa2b17f242 None admin] RBAC: Authorizing `identity:get_project(project_id=71b22e4f941b41ff98840b682cb8f0e8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:59.525201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1fbac-2722-4bee-8b23-01aa2b17f242 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:59.526953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 571/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:44:59 2022] GET /identity/v3/projects/71b22e4f941b41ff98840b682cb8f0e8 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:59.534042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:59.650637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014e69-cfbf-438c-bdcb-0876e23bd787 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:59.659993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:59.687448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:59.688103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:59.688392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:59.688669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:59.689524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=71b22e4f941b41ff98840b682cb8f0e8, user.id=f3e5068d8b214bec845dec916f64d8d4) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:59.689871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:59.691329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7368977-1442-4392-ac3b-ad6f1c9deaea None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:59.697074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 575/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:44:59 2022] GET /identity/v3/role_assignments?user.id=f3e5068d8b214bec845dec916f64d8d4&scope.project.id=71b22e4f941b41ff98840b682cb8f0e8&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:01.681216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a853388-2056-42a9-a71b-8ca2847a65d9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:01.681823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a853388-2056-42a9-a71b-8ca2847a65d9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:01.681823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a853388-2056-42a9-a71b-8ca2847a65d9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:01.683188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 572/1147] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:45:01.690043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:01.690773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:01.690900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:01.712010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:01.717762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:01.790609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 576/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:01.824738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a853388-2056-42a9-a71b-8ca2847a65d9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:01.839431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:01.951406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a853388-2056-42a9-a71b-8ca2847a65d9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:01.986837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:01.987629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:01.987913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:01.988187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:01.999046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:45:02.006612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:45:02.007849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:45:02.009216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 573/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:45:02.018109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:02.132797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de0fec-d3c6-49c5-9d16-4e0e548d77f4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:02.134424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:02.172610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:02.173281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:02.173562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:02.173871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:02.174628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:02.174943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:02.176332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:02.184912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 577/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:02.194638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:02.277222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:02.309743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bdb4d-24c1-44e2-8b65-daf707e57624 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:02.345063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:02.345967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:02.346246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:02.346516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] PATH_INFO: `/v3/users/f3e5068d8b214bec845dec916f64d8d4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:02.347827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] RBAC: Authorizing `identity:get_user(user_id=f3e5068d8b214bec845dec916f64d8d4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:02.349259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:02.351126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 574/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:45:02 2022] GET /identity/v3/users/f3e5068d8b214bec845dec916f64d8d4 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:02.358147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:02.488509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6b81-169e-425c-8642-b0ff5532281f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:02.525591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3945d7-d566-4505-b789-4a163d1dd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:02.526483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3945d7-d566-4505-b789-4a163d1dd5ae None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:02.526767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3945d7-d566-4505-b789-4a163d1dd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:02.527044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3945d7-d566-4505-b789-4a163d1dd5ae None admin] PATH_INFO: `/v3/projects/71b22e4f941b41ff98840b682cb8f0e8` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:02.528316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3945d7-d566-4505-b789-4a163d1dd5ae None admin] RBAC: Authorizing `identity:get_project(project_id=71b22e4f941b41ff98840b682cb8f0e8)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:02.529724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3945d7-d566-4505-b789-4a163d1dd5ae None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:02.531432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 578/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:45:02 2022] GET /identity/v3/projects/71b22e4f941b41ff98840b682cb8f0e8 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:02.537779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:02.652713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037aa5c-5dc1-460a-874f-a291f1594539 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:02.690828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12e71e-291c-4c5f-a091-dbdebf2cf148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:02.691723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e71e-291c-4c5f-a091-dbdebf2cf148 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:02.692002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e71e-291c-4c5f-a091-dbdebf2cf148 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:02.692269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12e71e-291c-4c5f-a091-dbdebf2cf148 None admin] PATH_INFO: `/v3/projects/71b22e4f941b41ff98840b682cb8f0e8/users/f3e5068d8b214bec845dec916f64d8d4/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:02.694278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e71e-291c-4c5f-a091-dbdebf2cf148 None admin] RBAC: Authorizing `identity:create_grant(project_id=71b22e4f941b41ff98840b682cb8f0e8, user_id=f3e5068d8b214bec845dec916f64d8d4, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:02.695768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12e71e-291c-4c5f-a091-dbdebf2cf148 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:02.709365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:02.716015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 575/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:45:02 2022] PUT /identity/v3/projects/71b22e4f941b41ff98840b682cb8f0e8/users/f3e5068d8b214bec845dec916f64d8d4/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:45:04.743714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6540d-5732-4eda-ac6a-66fb59e0c8fd None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:04.744304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6540d-5732-4eda-ac6a-66fb59e0c8fd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:04.744304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6540d-5732-4eda-ac6a-66fb59e0c8fd None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:04.745706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 579/1154] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:04.752278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:04.752979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:04.753166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:04.773893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:04.775125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:04.845560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 576/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:04.872540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6540d-5732-4eda-ac6a-66fb59e0c8fd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:04.911025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:04.988898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6540d-5732-4eda-ac6a-66fb59e0c8fd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:05.023403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:05.024201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:05.024487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:05.024768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:05.036167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:45:05.044019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:45:05.045067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:45:05.046130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 580/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:45:05.052281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:05.169722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feeb11e-20bd-4cfe-8faf-4506009731a9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:05.196753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:05.210317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:05.211064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:05.211347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:05.211624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:05.212382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:05.212683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:05.214095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:05.222201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 577/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:05.229040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:05.338310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:05.349150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cdac8-69dc-4f0b-be02-d24d01ddb5f2 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:05.385429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:05.386330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:05.386614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:05.386890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] PATH_INFO: `/v3/users/f3e5068d8b214bec845dec916f64d8d4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:05.388146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] RBAC: Authorizing `identity:get_user(user_id=f3e5068d8b214bec845dec916f64d8d4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:05.389590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:05.391268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 581/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:45:05 2022] GET /identity/v3/users/f3e5068d8b214bec845dec916f64d8d4 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:05.398126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:05.508645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a940d-2503-4128-989a-e2a9909db717 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:05.542845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:05.543509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:05.543780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:05.544058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:05.603391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:05.620317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:05.622734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:05.736457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 578/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:45:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:45:05.743267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:05.853874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb75294-032d-4eac-bd11-f6350acfaca8 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:05.902795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4f0a-62e9-483b-b274-acc69dff5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:05.903665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4f0a-62e9-483b-b274-acc69dff5988 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:05.903947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4f0a-62e9-483b-b274-acc69dff5988 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:05.904229 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4f0a-62e9-483b-b274-acc69dff5988 None admin] PATH_INFO: `/v3/projects/71b22e4f941b41ff98840b682cb8f0e8` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:05.905554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4f0a-62e9-483b-b274-acc69dff5988 None admin] RBAC: Authorizing `identity:get_project(project_id=71b22e4f941b41ff98840b682cb8f0e8)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:05.907047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4f0a-62e9-483b-b274-acc69dff5988 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:05.908781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 582/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:45:05 2022] GET /identity/v3/projects/71b22e4f941b41ff98840b682cb8f0e8 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:05.915526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:06.013479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:06.026182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d74d46-3a39-4c3b-bec0-e0e335f8a061 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:06.067129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:06.067788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:06.068075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:06.068352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:06.069195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=71b22e4f941b41ff98840b682cb8f0e8, user.id=f3e5068d8b214bec845dec916f64d8d4) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:06.069505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:06.071055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0f3d-5be3-4bd7-bd8f-e8a97835eebd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:06.085175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 579/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:45:05 2022] GET /identity/v3/role_assignments?user.id=f3e5068d8b214bec845dec916f64d8d4&scope.project.id=71b22e4f941b41ff98840b682cb8f0e8&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:08.204370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb96e-fb1d-4ab1-9d49-e4d091789b21 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:08.205002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb96e-fb1d-4ab1-9d49-e4d091789b21 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:08.205002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb96e-fb1d-4ab1-9d49-e4d091789b21 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:08.206454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 583/1162] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:08.212749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:08.213328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:08.213328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:08.237403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:08.238661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:08.316682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 580/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:08.348916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb96e-fb1d-4ab1-9d49-e4d091789b21 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:08.384477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:08.472705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb96e-fb1d-4ab1-9d49-e4d091789b21 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:08.509187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:08.509964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:08.510211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:08.510504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:08.583709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:08.585204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:08.613623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:08.690163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 584/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:45:08.697046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:08.794130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:08.815097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd2a37-2789-4003-a8d9-e1a55c0b7af4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:08.851081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:08.851893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:08.852181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:08.852446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:08.859385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:08.860872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c14cb13c-27fa-4a37-bead-002ebfe24df1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:45:08.876362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:45:08.877625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:45:08.878697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 581/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:45:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:45:08.884769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:08.990473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422484c0-52a9-4ede-b8fd-26e0376dcad4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:09.017612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:09.029523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:09.030240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:09.030526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:09.030798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:09.031528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:09.031832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:09.033212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911902-d91e-4511-ab8c-0cbc926da994 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:09.041095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 585/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Jun 23 11:45:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:45:11.069465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08146596-d5de-4ba0-b3a4-3bf923cdde84 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:11.070552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08146596-d5de-4ba0-b3a4-3bf923cdde84 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:11.070552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08146596-d5de-4ba0-b3a4-3bf923cdde84 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:11.072975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 582/1167] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:11.078499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6963-907f-4376-b02b-29c436080c59 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:11.078942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6963-907f-4376-b02b-29c436080c59 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:11.079034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6963-907f-4376-b02b-29c436080c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:11.097712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a0dd6963-907f-4376-b02b-29c436080c59 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:11.098916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a0dd6963-907f-4376-b02b-29c436080c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:11.184146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 586/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:11.217236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08146596-d5de-4ba0-b3a4-3bf923cdde84 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:11.331931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08146596-d5de-4ba0-b3a4-3bf923cdde84 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:11.369179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a4c45-ebff-4066-972e-20ca34a8ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:11.369876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a4c45-ebff-4066-972e-20ca34a8ca6d None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:11.370192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a4c45-ebff-4066-972e-20ca34a8ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:11.370471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a4c45-ebff-4066-972e-20ca34a8ca6d None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:11.371216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a4c45-ebff-4066-972e-20ca34a8ca6d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:11.372649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a4c45-ebff-4066-972e-20ca34a8ca6d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:11.390331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 583/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Thu Jun 23 11:45:11 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:45:13.448320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02471c-6b51-453a-8eaf-318e2f98b74d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:13.449248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02471c-6b51-453a-8eaf-318e2f98b74d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:13.449248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02471c-6b51-453a-8eaf-318e2f98b74d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:13.451448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 587/1170] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:13.460339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:13.460995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:13.460995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:13.467908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:13.485330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:13.487254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:13.562076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 584/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:13.586884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02471c-6b51-453a-8eaf-318e2f98b74d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:13.725516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02471c-6b51-453a-8eaf-318e2f98b74d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:13.750597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:13.764751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633947b-244b-4da8-8c76-4f650e2f4193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:13.765632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633947b-244b-4da8-8c76-4f650e2f4193 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:13.765926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633947b-244b-4da8-8c76-4f650e2f4193 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:13.766196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633947b-244b-4da8-8c76-4f650e2f4193 None admin] PATH_INFO: `/v3/domains/501e8a8b729a42b29e89ac20787c2086` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:13.778177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633947b-244b-4da8-8c76-4f650e2f4193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=501e8a8b729a42b29e89ac20787c2086)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:13.779634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633947b-244b-4da8-8c76-4f650e2f4193 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:13.781310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 588/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Jun 23 11:45:13 2022] GET /identity/v3/domains/501e8a8b729a42b29e89ac20787c2086 => generated 267 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:13.788580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:13.896884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a5ea8-fe66-4477-8f7b-36ce7c9aa689 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:13.940648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e60c-abc3-47e6-ad43-90c787876bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:13.941698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e60c-abc3-47e6-ad43-90c787876bb7 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:13.942107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e60c-abc3-47e6-ad43-90c787876bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:13.942510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e60c-abc3-47e6-ad43-90c787876bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:13.943634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139e60c-abc3-47e6-ad43-90c787876bb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:13.945523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139e60c-abc3-47e6-ad43-90c787876bb7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:13.948853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:13.974944 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 585/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:45:13 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:45:16.056389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d015e-f4c0-43ff-bcef-b73c511c7dd8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:16.056983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d015e-f4c0-43ff-bcef-b73c511c7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:16.056983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d015e-f4c0-43ff-bcef-b73c511c7dd8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:16.058982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 589/1174] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:16.067618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:16.068058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:16.068188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:16.087217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:16.088418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:16.162092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 586/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:16.199752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d015e-f4c0-43ff-bcef-b73c511c7dd8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:16.320717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d015e-f4c0-43ff-bcef-b73c511c7dd8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:16.356666 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eede4e-a5fb-497a-a65e-4d8a99465ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:16.357548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eede4e-a5fb-497a-a65e-4d8a99465ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:16.357859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eede4e-a5fb-497a-a65e-4d8a99465ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:16.358141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eede4e-a5fb-497a-a65e-4d8a99465ab3 None admin] PATH_INFO: `/v3/domains/501e8a8b729a42b29e89ac20787c2086` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:16.359364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eede4e-a5fb-497a-a65e-4d8a99465ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=501e8a8b729a42b29e89ac20787c2086)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:16.360819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eede4e-a5fb-497a-a65e-4d8a99465ab3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:16.362509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 590/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Jun 23 11:45:16 2022] GET /identity/v3/domains/501e8a8b729a42b29e89ac20787c2086 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:16.369118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:16.471500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb09c-1ef1-4ae0-a160-a874c2b2e0f5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:16.491092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:16.513388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e697bb5-1ed1-45eb-acc5-4a393844fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:16.514124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697bb5-1ed1-45eb-acc5-4a393844fe03 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:16.514394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697bb5-1ed1-45eb-acc5-4a393844fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:16.514669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e697bb5-1ed1-45eb-acc5-4a393844fe03 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:16.515389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e697bb5-1ed1-45eb-acc5-4a393844fe03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:16.516847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e697bb5-1ed1-45eb-acc5-4a393844fe03 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:16.540924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 587/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:45:16 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:45:18.639113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e2d73-6f0c-458a-9f03-abc3433bedd9 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:18.639669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e2d73-6f0c-458a-9f03-abc3433bedd9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:18.639669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e2d73-6f0c-458a-9f03-abc3433bedd9 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:18.641102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 591/1178] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:18.647987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:18.648430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:18.648537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:18.677027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:18.679208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:18.771480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 588/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:18.796368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e2d73-6f0c-458a-9f03-abc3433bedd9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:18.854985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:18.910267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e2d73-6f0c-458a-9f03-abc3433bedd9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:18.946403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:18.947202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:18.947501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:18.947772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:18.958981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:45:18.966828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:45:18.967917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:45:18.968755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 592/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:45:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:45:18.974489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:19.084764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3c20c-f587-4f3a-a936-2bf9889710cc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:19.086450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:19.126620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:19.127220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:19.127502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:19.127779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:19.128539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:19.128844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:19.130279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:19.139053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 589/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:19.145100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:19.257173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18604e00-d49a-42c6-8dc5-ffb6c4c9ab66 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:19.268191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:19.299319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:19.301203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:19.301490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:19.302145 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] PATH_INFO: `/v3/users/35af6b7ce6db4a7e96b758e06dc7e00a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:19.320564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] RBAC: Authorizing `identity:get_user(user_id=35af6b7ce6db4a7e96b758e06dc7e00a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:19.322080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:19.323872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 593/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:45:19 2022] GET /identity/v3/users/35af6b7ce6db4a7e96b758e06dc7e00a => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:45:19.330064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:19.456463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d3b49-6ea7-49a3-bbfd-79fa75f8f0f3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:19.502008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:19.502675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:19.502966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:19.503246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:19.538623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:19.582735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:19.584225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:19.696570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 590/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:45:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:45:19.704039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:19.853108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710bf1f-552c-4e1e-ad82-9f0a2280ae49 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:19.899218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22aa938-65e1-4378-a475-75594dd1367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:19.900100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa938-65e1-4378-a475-75594dd1367c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:19.900384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa938-65e1-4378-a475-75594dd1367c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:19.900646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aa938-65e1-4378-a475-75594dd1367c None admin] PATH_INFO: `/v3/projects/46586d53091b475fbecf39ad7ce90f54` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:19.901819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22aa938-65e1-4378-a475-75594dd1367c None admin] RBAC: Authorizing `identity:get_project(project_id=46586d53091b475fbecf39ad7ce90f54)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:19.903351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22aa938-65e1-4378-a475-75594dd1367c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:19.905085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 594/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:45:19 2022] GET /identity/v3/projects/46586d53091b475fbecf39ad7ce90f54 => generated 361 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:19.911788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:19.990135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:20.036805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfd07a-3619-4097-a656-a2b2f4e00396 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:20.076426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:20.077094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:20.077375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:20.077656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:20.078527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=46586d53091b475fbecf39ad7ce90f54, user.id=35af6b7ce6db4a7e96b758e06dc7e00a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:20.078947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:20.081070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59d14-0b1f-49fe-8be6-6287e2f445f4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:20.087182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 591/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:45:19 2022] GET /identity/v3/role_assignments?user.id=35af6b7ce6db4a7e96b758e06dc7e00a&scope.project.id=46586d53091b475fbecf39ad7ce90f54&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:22.119524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88ac3-0712-4105-8cc9-274bf577655b None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:22.120122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88ac3-0712-4105-8cc9-274bf577655b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:22.120122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88ac3-0712-4105-8cc9-274bf577655b None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:22.121456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 595/1186] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:22.126691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:22.127119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:22.127221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:22.146705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:22.148141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:22.222751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 592/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:22.246909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca88ac3-0712-4105-8cc9-274bf577655b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:22.294902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:22.364365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca88ac3-0712-4105-8cc9-274bf577655b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:22.402723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:22.403432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:22.403710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:22.403989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:22.415632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:45:22.423090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:45:22.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:45:22.425006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 596/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:45:22.431359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:22.500372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:22.549628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e2be-8de4-4cde-ab26-b13ba60bc68e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:22.586167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:22.586854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:22.587139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:22.587420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:22.588183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:22.588498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:22.589934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:22.598137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 593/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:45:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:22.604734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:22.716268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:22.725482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af855-5b27-4280-af2e-fbf343d74841 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:22.764123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:22.765008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:22.765298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:22.765582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] PATH_INFO: `/v3/users/35af6b7ce6db4a7e96b758e06dc7e00a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:22.766884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] RBAC: Authorizing `identity:get_user(user_id=35af6b7ce6db4a7e96b758e06dc7e00a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:22.768375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:22.770079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 597/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:45:22 2022] GET /identity/v3/users/35af6b7ce6db4a7e96b758e06dc7e00a => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:22.777495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:22.906754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda1e6-e94c-4c3f-85c7-e3a402354d68 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:22.932131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:22.951420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635d85e-039f-47e4-9049-c0b5ebd95901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:22.952300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d85e-039f-47e4-9049-c0b5ebd95901 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:22.952584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d85e-039f-47e4-9049-c0b5ebd95901 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:22.952860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d85e-039f-47e4-9049-c0b5ebd95901 None admin] PATH_INFO: `/v3/projects/46586d53091b475fbecf39ad7ce90f54` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:22.954141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635d85e-039f-47e4-9049-c0b5ebd95901 None admin] RBAC: Authorizing `identity:get_project(project_id=46586d53091b475fbecf39ad7ce90f54)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:22.955603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635d85e-039f-47e4-9049-c0b5ebd95901 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:22.957341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 594/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:45:22 2022] GET /identity/v3/projects/46586d53091b475fbecf39ad7ce90f54 => generated 361 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:22.963991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:23.072942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da1558-b12f-4ed2-bc71-83d752aefc11 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:23.111185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf5e65-0aab-4a60-9d46-1f4eb65fa990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:23.112083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5e65-0aab-4a60-9d46-1f4eb65fa990 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:23.112364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5e65-0aab-4a60-9d46-1f4eb65fa990 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:23.112639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf5e65-0aab-4a60-9d46-1f4eb65fa990 None admin] PATH_INFO: `/v3/projects/46586d53091b475fbecf39ad7ce90f54/users/35af6b7ce6db4a7e96b758e06dc7e00a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:23.115193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf5e65-0aab-4a60-9d46-1f4eb65fa990 None admin] RBAC: Authorizing `identity:create_grant(project_id=46586d53091b475fbecf39ad7ce90f54, user_id=35af6b7ce6db4a7e96b758e06dc7e00a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:23.116685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf5e65-0aab-4a60-9d46-1f4eb65fa990 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:23.136739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 598/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:45:22 2022] PUT /identity/v3/projects/46586d53091b475fbecf39ad7ce90f54/users/35af6b7ce6db4a7e96b758e06dc7e00a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:45:25.153252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b18b-1535-4b53-aaac-452a04c2748f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:25.154228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b18b-1535-4b53-aaac-452a04c2748f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:25.154228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b18b-1535-4b53-aaac-452a04c2748f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:25.156457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 595/1193] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:45:25.163099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:25.163583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:25.163675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:25.188462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:45:25.190229 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:45:25.212256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:25.272811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 599/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:45:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:45:25.297021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b18b-1535-4b53-aaac-452a04c2748f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:25.414171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b18b-1535-4b53-aaac-452a04c2748f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:25.454035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:25.454834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:25.455113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:25.455390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:25.467062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:45:25.474629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:45:25.475858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:45:25.477519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 596/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:45:25.484708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:25.592049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a740e7-23b0-44bf-a1ea-c010c10ded07 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:25.633580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:25.634299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:25.634586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:25.634865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:25.635627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:25.635941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:25.637333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:25.645796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 600/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:25.651803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:25.713510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:25.764932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995b11-fb00-43c0-b9b8-49732b00faa1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:25.797999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:25.798968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:25.799423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:25.799873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] PATH_INFO: `/v3/users/35af6b7ce6db4a7e96b758e06dc7e00a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:25.801929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] RBAC: Authorizing `identity:get_user(user_id=35af6b7ce6db4a7e96b758e06dc7e00a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:25.804699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:25.807916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 597/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Jun 23 11:45:25 2022] GET /identity/v3/users/35af6b7ce6db4a7e96b758e06dc7e00a => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:25.817549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:25.844419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:25.935066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30221a2c-0f5e-45cf-9312-b0cad14497f9 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:25.969575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:25.970173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:25.970454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:25.970732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:26.042797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:26.044282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:26.062173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:26.152780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 601/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:45:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:45:26.159611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:26.277609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d0b3-f180-4c88-88f7-8f64fb599d3a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:26.296130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:26.317272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887245e-e5b7-43f5-a297-86d233e60f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:26.318178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887245e-e5b7-43f5-a297-86d233e60f23 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:26.318467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887245e-e5b7-43f5-a297-86d233e60f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:26.318745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887245e-e5b7-43f5-a297-86d233e60f23 None admin] PATH_INFO: `/v3/projects/46586d53091b475fbecf39ad7ce90f54` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:26.320302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887245e-e5b7-43f5-a297-86d233e60f23 None admin] RBAC: Authorizing `identity:get_project(project_id=46586d53091b475fbecf39ad7ce90f54)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:26.321793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887245e-e5b7-43f5-a297-86d233e60f23 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:26.323518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 598/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Jun 23 11:45:26 2022] GET /identity/v3/projects/46586d53091b475fbecf39ad7ce90f54 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:26.330048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:45:26.443783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cea753-e1b0-4e3f-9354-3a0965e15e51 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:45:26.461321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:26.482991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:45:26.483652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:45:26.483910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:45:26.484217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:45:26.485071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=46586d53091b475fbecf39ad7ce90f54, user.id=35af6b7ce6db4a7e96b758e06dc7e00a) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:45:26.485388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:45:26.486857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c260905-ed76-4c74-a31f-69b9ee0c6342 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:45:26.493583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 602/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:45:26 2022] GET /identity/v3/role_assignments?user.id=35af6b7ce6db4a7e96b758e06dc7e00a&scope.project.id=46586d53091b475fbecf39ad7ce90f54&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:45:36.312517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:36.490841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=10 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:22.839393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c1859-d99d-4d2b-ae16-34a40c2f9040 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:22.839393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c1859-d99d-4d2b-ae16-34a40c2f9040 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:22.839393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c1859-d99d-4d2b-ae16-34a40c2f9040 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:22.839393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 599/1201] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:22.845987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:22.847303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:22.847303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:22.872590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:22.874384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:22.963808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 603/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:22.991285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c1859-d99d-4d2b-ae16-34a40c2f9040 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:23.127924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c1859-d99d-4d2b-ae16-34a40c2f9040 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:23.176650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:23.177582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:23.178044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:23.178325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:23.192756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:23.194419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:23.216903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:23.218021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:23.218965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:23.218965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:23.218965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:23.218965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:23.223485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 600/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:46:23.225796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:23.353131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a27af-0a31-4851-b2c9-f9ce0ba303e1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:23.404670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:23.413569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:23.414517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:23.414908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:23.415298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:23.416200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:23.416675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:23.418323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8746906-0155-4024-bd2a-c1b20f8ebf1a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:23.437251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 604/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:23.443823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:23.510241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:23.571735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0e18-a926-4074-b675-eb414fef8983 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:23.615861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cff9e-01c3-4411-95ad-f04022975824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:23.616657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cff9e-01c3-4411-95ad-f04022975824 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:23.616963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cff9e-01c3-4411-95ad-f04022975824 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:23.617234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cff9e-01c3-4411-95ad-f04022975824 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:23.618426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cff9e-01c3-4411-95ad-f04022975824 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:23.619680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cff9e-01c3-4411-95ad-f04022975824 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:23.651655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 601/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Jun 23 11:46:23 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:46:25.897330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4005-76ec-4d81-b6af-48a414edb588 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:25.897905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4005-76ec-4d81-b6af-48a414edb588 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:25.897905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4005-76ec-4d81-b6af-48a414edb588 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:25.901641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 605/1206] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:25.905393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:25.905886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:25.906018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:25.924788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:25.926057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:26.010678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 602/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:26.035948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4005-76ec-4d81-b6af-48a414edb588 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:26.174460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4005-76ec-4d81-b6af-48a414edb588 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:26.216234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:26.217140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:26.217420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:26.217759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:26.230121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:46:26.238231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:26.239550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:46:26.240464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:26.244929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 606/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:26.246544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:26.296782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:26.370019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534d973-1631-48c4-a66d-4972e7164e9d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:26.411906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:26.413392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:26.413770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:26.414100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:26.415012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:26.415416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:26.417055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:26.427997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 603/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:26.435283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:26.499287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:26.560723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b3519-1fd4-479d-bc16-eb4ec23ecc6f None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:26.610255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:26.611179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:26.611469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:26.611747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:26.627560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:26.629151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:26.651035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:26.655337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:26.656260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:26.656260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:26.656260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:26.656260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:26.657822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 607/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:26.658423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:26.783867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:26.788339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dc812-5ba7-4887-aea6-4e47758b0a97 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:26.828169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:26.829040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:26.829329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:26.829706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:26.830566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:26.831007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:26.832538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:26.847619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 604/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:26.854243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:26.982842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb86d6-0dec-44d8-8006-abf426e65960 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:26.985054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:27.023790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:27.024601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:27.024886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:27.025220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:27.034708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:27.036474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:46:27.053414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:27.054909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:27.056153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:27.057765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 608/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:27.060975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:27.180112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8eb9c-b156-4c75-bef9-e923e5e503ed None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:27.232114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:27.233142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:27.233676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:27.234109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:27.235251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:27.235579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:27.237048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:27.260992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 605/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 23 11:46:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:27.267160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:27.391368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad92b8-3c3b-4af2-bb3b-1c1bedd5a9c4 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:27.428046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:27.428981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:27.429314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:27.429548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:27.465585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:27.512841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:27.514393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:27.641042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 609/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:46:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:46:27.646760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:27.668569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:27.779943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f588b0-c4fe-4bba-bb07-028fff19753f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:27.820889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:27.821815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:27.822102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:27.822426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:27.834692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:27.836349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:27.856324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:27.857271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:27.858217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:27.858217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:27.858217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:27.858217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:27.858217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 606/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:27.864409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:27.946763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:27.992875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8be07a-11e2-49c0-a9a9-69007f647a66 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:28.035350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:28.036047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:28.036339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:28.036620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:28.037827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:28.038144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:28.039692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:28.058341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 610/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:46:28.060289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:28.144132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:28.177205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250053df-e7c4-41e6-9de2-9671412642ff None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:28.213901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:28.214636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:28.214917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:28.215190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:28.222384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:28.223904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:46:28.237988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:28.239664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:28.241125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:28.244560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 607/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:28.245635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:28.360204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0efbb-b38b-448d-ae30-1c450293b079 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:28.390466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:28.403419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:28.404215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:28.404568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:28.404919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:28.405805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:28.406228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:28.407738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63750d-ec34-454d-8469-b1e9ed98bb38 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:28.426153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 611/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:28.427173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:28.546751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ddfe3-5d02-4164-8a70-30ce839001fd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:28.586514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:28.595775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:28.598055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:28.598055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:28.598055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:28.598055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=12a98501cfe942dda4c2c8350215bcea) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:28.598412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:28.601630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760196c6-0119-4ee6-bf39-0c255ca478d0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:28.617701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 608/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:46:28 2022] GET /identity/v3/role_assignments?user.id=12a98501cfe942dda4c2c8350215bcea&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:46:30.925010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce4e1-9f03-4244-8845-6b4dd9b0149d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:30.925559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce4e1-9f03-4244-8845-6b4dd9b0149d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:30.925559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce4e1-9f03-4244-8845-6b4dd9b0149d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:30.926884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 612/1220] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:30.933434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:30.933943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:30.934057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:30.952724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:30.953937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:31.032104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 609/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:31.058138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ce4e1-9f03-4244-8845-6b4dd9b0149d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:31.170800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ce4e1-9f03-4244-8845-6b4dd9b0149d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:31.212444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:31.213228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:31.213521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:31.213844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:31.225650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:46:31.233551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:31.234703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:31.235777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 613/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:46:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:46:31.241699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:31.355758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df27b0-9d24-4e26-aa54-15d2af9a1763 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:31.383417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:31.396161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:31.397531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:31.397890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:31.398215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:31.399024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:31.399424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:31.400919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:31.411238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 610/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:31.417771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:31.464154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:31.527583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72669744-8808-4413-8ca4-8cf2cb966360 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:31.564969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:31.565828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:31.566154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:31.566402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:31.578678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:31.580187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:31.599289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:31.600734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:31.601928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:31.601928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:31.601928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:31.601928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:31.601928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 614/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:31.614899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:31.731516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2cb5-1cbb-4471-b557-502f1723cb62 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:31.768159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:31.768836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:31.769122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:31.769403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:31.770390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:31.770698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:31.772669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:31.790427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 611/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:31.792074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:31.892580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:31.901883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554f1d9-a0fc-40e8-a929-6d28349e2fc0 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:31.937661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:31.938484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:31.938774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:31.939052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:31.950713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:31.950713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:46:31.968835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:31.970151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:31.971273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 615/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:31.977696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:32.030401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:32.090747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa396-6160-4863-a930-57c4035a15fe None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:32.126523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:32.127206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:32.127483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:32.127761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:32.128669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:32.128926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:32.130404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:32.149485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 612/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 23 11:46:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:32.155164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:32.275219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c74e6-a9c7-4215-a61a-8fd310c09d57 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:32.319353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:32.320112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:32.320446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:32.320779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:32.332902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:32.334445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:32.352047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:32.353148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:32.354217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:32.354217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:32.354217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:32.354217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:32.354217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 616/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:32.359201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:32.471991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d9271-6731-4447-b2c3-33eec8c3b38b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:32.475508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:32.510695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:32.511371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:32.511651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:32.511928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:32.512661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:32.512961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:32.514371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:32.527141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 613/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:32.533170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:32.543615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:32.645784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696757-c712-409a-9b9c-a82a88afe765 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:32.685183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:32.686176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:32.686495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:32.687033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:32.695399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:32.697087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:46:32.715439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:32.716683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:32.724207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 617/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:32.725680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:32.849966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff6a9-1704-425e-a005-9a6ea92d7a7a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:32.894713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:32.895282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:32.895562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:32.895839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:32.896744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:32.897263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:32.898772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347b99-8788-4226-8f89-52cf8c07982c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:32.911434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 614/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:32.919938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:32.994905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:33.039020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd22d-3183-48c6-8aef-9411b5fcde60 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:33.077795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835dfa4-0202-4e76-9ad1-9972ec9f5ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:33.078693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835dfa4-0202-4e76-9ad1-9972ec9f5ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:33.078979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835dfa4-0202-4e76-9ad1-9972ec9f5ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:33.079262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835dfa4-0202-4e76-9ad1-9972ec9f5ef3 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/12a98501cfe942dda4c2c8350215bcea/roles/5cb36697203d4a5fb34eb0c23648a767` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:33.095077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835dfa4-0202-4e76-9ad1-9972ec9f5ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=12a98501cfe942dda4c2c8350215bcea, role_id=5cb36697203d4a5fb34eb0c23648a767)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:33.096540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835dfa4-0202-4e76-9ad1-9972ec9f5ef3 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:33.110069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 618/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:46:32 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/12a98501cfe942dda4c2c8350215bcea/roles/5cb36697203d4a5fb34eb0c23648a767 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:46:35.234743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e99c3-c2cb-4abe-a38e-3a78e5303301 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:35.235515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e99c3-c2cb-4abe-a38e-3a78e5303301 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:35.235515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e99c3-c2cb-4abe-a38e-3a78e5303301 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:35.236664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 615/1233] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:35.242884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:35.243592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:35.243592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:35.261582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:35.263147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:35.352508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 619/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:35.377627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e99c3-c2cb-4abe-a38e-3a78e5303301 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:35.405043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:35.486960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e99c3-c2cb-4abe-a38e-3a78e5303301 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:35.523191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:35.523997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:35.524278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:35.524550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:35.538144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:46:35.546635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:35.547737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:35.548823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 616/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Jun 23 11:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:35.554048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:35.605838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:35.663471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00670e-ea91-4db1-b241-dc2f6913b5aa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:35.699888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:35.700617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:35.700905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:35.701185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:35.701982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] RBAC: Adding query filter params (name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:35.702287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:35.703832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:35.713291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 620/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Jun 23 11:46:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:46:35.719625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:35.815150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:35.831657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc69486-28a0-453a-b9b3-7762b410629d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:35.871188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:35.872013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:35.872297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:35.872575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:35.884954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:35.886563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:35.905762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:35.906916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:35.907884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:35.907884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:35.907884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:35.907884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:35.907884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 617/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:35.913532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:36.026071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddadaaa-4d78-42c1-b85a-bba820feb796 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:36.035675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:36.065057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:36.066054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:36.066179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:36.066362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:36.067125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:36.067408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:36.068994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:36.081935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 621/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:36.088321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:36.199024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd105-8778-44a0-bce3-a0c3d16d64de None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:36.236561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:36.237485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:36.237799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:36.238079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:36.243295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:36.249374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:36.251110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:46:36.267718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:36.268842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:36.269973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 618/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:36.275507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:36.399093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ade79a-16ba-4026-acd1-3e504b6b890d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:36.436021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:36.436707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:36.436996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:36.437277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:36.438364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:36.438681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:36.440324 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:36.463546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 622/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 23 11:46:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:36.464898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:36.586041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1331fd-15e8-43a1-906c-78fd40ad5aa4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:36.630914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:36.631528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:36.631848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:36.632125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:36.699360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:36.708660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:36.710401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:36.820126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 619/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:46:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:46:36.827467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:36.858266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:36.949773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f12c-5158-46ad-8d1e-38eeb44cdf8a None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:36.995547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:36.996354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:36.996630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:36.996901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:37.009322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:37.010886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:37.029083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:37.031215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:37.033214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:37.033214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:37.033214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:37.033214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:37.035099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 623/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:46:37.036285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:37.141103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:37.148792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473ca33-ccf2-4bdc-98d2-ce58adc4d215 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:37.186784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:37.187530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:37.187840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:37.188160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:37.188999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:37.189304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:37.190926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:37.203770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 620/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:37.210086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:37.312721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:37.340890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514d726-a48a-4069-9a30-1e79724d1b06 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:37.384048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:37.384883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:37.385156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:37.385432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:37.392321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:37.393790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:46:37.407999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:37.409247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:37.410207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 624/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:37.416013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:37.533429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a888-c88a-4d15-80a2-2ebc98374558 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:37.575046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:37.575800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:37.576019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:37.576314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:37.577160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:37.577473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:37.579029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdb1d7-731f-4943-96ef-7db2ba7e0038 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:37.592287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 621/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:37.598693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:37.714833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dcacb-7e34-47df-8b2a-b4da1153ec0c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:37.752039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:37.752811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:37.753091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:37.753404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:37.754380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] RBAC: Adding query filter params (role.id=5cb36697203d4a5fb34eb0c23648a767, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=12a98501cfe942dda4c2c8350215bcea) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:37.754692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:37.756534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94fd5e-f7f3-4688-aaf5-13e12dcd2ab5 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:37.763668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 625/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:46:37 2022] GET /identity/v3/role_assignments?user.id=12a98501cfe942dda4c2c8350215bcea&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=5cb36697203d4a5fb34eb0c23648a767 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:39.986767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153132d-60db-49db-aa8b-0d738698a57a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:39.987482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153132d-60db-49db-aa8b-0d738698a57a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:39.987482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153132d-60db-49db-aa8b-0d738698a57a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:39.988613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 622/1247] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:39.994887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:39.995517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:39.995517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:40.000920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:40.016851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:40.018158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:40.096965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 626/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:46:40.122827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153132d-60db-49db-aa8b-0d738698a57a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:40.143829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:40.245567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153132d-60db-49db-aa8b-0d738698a57a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:40.299332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:40.300344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:40.300760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:40.301091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:40.315152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:46:40.323883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:40.326021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:40.327059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 623/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:40.331957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:40.450341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13679b-f77d-4d8d-be16-c1be31140b58 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:40.484028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:40.490049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:40.490733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:40.491013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:40.491286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:40.492127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:40.492393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:40.493822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:40.503262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 627/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:40.510678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:40.604455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:40.633017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a7c4a-1abe-4116-b64b-c8b9358ee16a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:40.673315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:40.674268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:40.674681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:40.675057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:40.687277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:40.688771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:40.706816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:40.708011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:40.709308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:40.709308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:40.709308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:40.709308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:40.709308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 624/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:40.714728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:40.834694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c7ab-1d4a-495a-a23e-64c8e055a020 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:40.876934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:40.877737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:40.878055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:40.878345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:40.879165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:40.879503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:40.881151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:40.896681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 628/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:40.903424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:41.023281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2a720-5235-42cd-85e5-44f7422da809 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:41.052029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:41.062678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:41.063508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:41.063792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:41.064067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:41.074002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:41.075493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:46:41.091293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:41.092543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:41.093743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:41.097390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 625/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:41.098524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:41.163893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:41.208279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f879e-7fee-4cfa-bb08-69fb971a5b39 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:41.243454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:41.244152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:41.244418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:41.244694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:41.245539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:41.246007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:41.247442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:41.275583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 629/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 23 11:46:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:46:41.276898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:41.398543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef265c0-a0b6-40a6-a556-ff5bd45b894e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:41.435769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:41.436636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:41.437034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:41.437407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:41.499844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:41.514816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:41.518801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:41.634528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 626/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:46:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:46:41.641070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:41.758251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc01614-c274-49ac-8b63-53416cbeef11 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:41.773575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:41.798736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:41.799841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:41.800210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:41.800603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:41.813491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:41.815331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:41.835394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:41.836573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:41.837896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:41.837896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:41.837896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:41.837896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:41.837896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 630/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:46:41.842676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:41.944633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:41.957334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278678b-06ab-4849-9ab8-b8e0e95cc89e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:41.993119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:41.993839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:41.994122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:41.994391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:41.995136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:41.995440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:41.996836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:42.009804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 627/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:46:42.016374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:42.123055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ffa9-72d3-4e76-8b90-21ae9c55828c None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:42.163075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:42.163911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:42.164204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:42.164479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:42.172225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:42.173932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:46:42.188868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:42.190012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:42.191246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 631/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:42.196582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:42.330773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9d803-b156-4ae0-967d-2eabbb15a65c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:42.373062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:42.373762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:42.374045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:42.374317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:42.375108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:42.375414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:42.376871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46314b-4345-42fc-9807-02f5bac204e6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:42.389954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 628/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:42.396306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:42.430484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:42.516543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc9b4e-2fa6-49db-99a7-74d3a6183566 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:42.552602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:42.553268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:42.553559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:42.553981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:42.554696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=12a98501cfe942dda4c2c8350215bcea) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:42.555008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:42.556468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057a8c-9a18-4789-b37a-4eed998ce055 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:42.562638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 632/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:46:42 2022] GET /identity/v3/role_assignments?user.id=12a98501cfe942dda4c2c8350215bcea&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=2702c53281284456a65007036b36070c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:44.655046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aa4a8-74b5-4c2e-a625-122e8cae9966 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:44.655850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aa4a8-74b5-4c2e-a625-122e8cae9966 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:44.655850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aa4a8-74b5-4c2e-a625-122e8cae9966 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:44.665741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 629/1261] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:44.672355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:44.672819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:44.672941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:44.698250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:44.699455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:44.778046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 633/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:44.801238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aa4a8-74b5-4c2e-a625-122e8cae9966 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:44.813396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:44.913161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aa4a8-74b5-4c2e-a625-122e8cae9966 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:44.952747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:44.953539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:44.953856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:44.954134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:44.965934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:46:44.973531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:44.974720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:44.975785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 630/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:44.981621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:45.004033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:45.090457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59cf83-5936-4c6f-aa43-35549a79c71d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:45.130237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:45.130984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:45.131422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:45.131693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:45.132449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:45.132757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:45.134159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:45.143262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 634/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:45.149977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:45.220789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:45.256068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0521b6-a660-4dd7-8603-91c693560679 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:45.301251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:45.302489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:45.303075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:45.303621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:45.319372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:45.321222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:45.343098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:45.344239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:45.345433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:45.345433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:45.345433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:45.345433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:45.345433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 631/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:45.350371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:45.437484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:45.461490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949f472-33e8-43aa-94f9-28fa9dff2970 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:45.502052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:45.502630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:45.502911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:45.503185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:45.503909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:45.504216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:45.505754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:45.521093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 635/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:45.527449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:45.649975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c965-5527-474a-8c4d-4730892af716 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:45.671164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:45.688381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:45.689193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:45.689481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:45.689795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:45.698398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:45.699995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:46:45.715719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:45.716708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:45.717907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 632/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:45.724963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:45.837120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212697d-419f-4e1c-aaa0-e616ff7cc850 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:45.875891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:45.876565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:45.876850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:45.877124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:45.878005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:45.878322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:45.879788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:45.888902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:45.898670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 636/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 23 11:46:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:46:45.904659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:46.008887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf21f4-cadc-4e29-b24b-8ba8cd11a76b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:46.043957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:46.044736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:46.045017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:46.045291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:46.056568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:46.058065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:46.075423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:46.076569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:46.078339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:46.078339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:46.078339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:46.078339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:46.078339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 633/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:46.085778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:46.197418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a391a-0a3b-4c41-9052-ea29e85f021e None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:46.234384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:46.235071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:46.235360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:46.235641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:46.236381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:46.236691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:46.238131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:46.250115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 637/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:46.258687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:46.295148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:46.384045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c2dd-34ab-4f8c-8b02-621ed5aa7da2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:46.423350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:46.424144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:46.424430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:46.424708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:46.432171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:46.433650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:46:46.448173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:46.449151 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:46.450174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 634/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:46:46.455854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:46.524184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:46.568512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e1989-58a2-453c-bc03-f56a3f3f33de None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:46.609318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:46.610033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:46.610319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:46.610591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:46.611397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:46.611710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:46.614269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cbcd4-15d8-436a-81e9-eb76631f3cb1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:46.633809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 638/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:46.640837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:46.746510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:46.757404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb503-ecc0-44a1-ad9b-983e4f07f394 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:46.794725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879c42-f6a7-4308-a714-d945717a94b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:46.795641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879c42-f6a7-4308-a714-d945717a94b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:46.795921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879c42-f6a7-4308-a714-d945717a94b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:46.796198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879c42-f6a7-4308-a714-d945717a94b3 None admin] PATH_INFO: `/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/12a98501cfe942dda4c2c8350215bcea/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:46.798446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b879c42-f6a7-4308-a714-d945717a94b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7763b1475407d9bf9d9bfa6a03701, user_id=12a98501cfe942dda4c2c8350215bcea, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:46.799905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b879c42-f6a7-4308-a714-d945717a94b3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:46.816899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 635/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Jun 23 11:46:46 2022] PUT /identity/v3/projects/0bc7763b1475407d9bf9d9bfa6a03701/users/12a98501cfe942dda4c2c8350215bcea/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:46:48.827457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114986-234e-4137-a969-21903ac914d7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:48.828044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114986-234e-4137-a969-21903ac914d7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:48.828044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114986-234e-4137-a969-21903ac914d7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:48.829583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 639/1274] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:46:48.835228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:48.835665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:48.835775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:48.857710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:48.858848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:48.933506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 636/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:48.957539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114986-234e-4137-a969-21903ac914d7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:49.080488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114986-234e-4137-a969-21903ac914d7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:49.101275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:49.123707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:49.124436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:49.124724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:49.125002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:49.136853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:46:49.149553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:49.150625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:49.151504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 640/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Jun 23 11:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:49.158629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:49.250427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:49.279279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24937b6-0821-4323-a264-4b3548f3da23 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:49.317078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:49.318242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:49.318242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:49.318656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:49.319393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:49.319701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:49.321100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:49.330027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 637/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Jun 23 11:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:49.336629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:49.449071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7a0bb-1dc6-41b6-8994-fef0463c9964 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:49.489864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:49.490961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:49.491249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:49.491530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:49.503075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:49.504537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:49.522508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:49.523609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:49.524683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:49.524683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:49.524683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:49.524683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:49.524683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 641/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:49.530499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:49.662372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b573-9e56-43fa-bd57-59f30b86f899 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:49.702598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:49.703488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:49.703908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:49.704319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:49.705439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:49.705938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:49.708107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:49.726212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 638/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:49.733357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:49.783325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:49.862177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017686e3-85d1-4d83-bbaf-439d19210a61 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:49.908178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:49.909451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:49.909974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:49.910433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:49.919341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:49.920790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:46:49.935728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:49.936788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:49.937842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 642/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:49.943100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:49.949025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:50.065506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82d5c-3fac-4da5-be9b-159b1086078b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:50.111965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:50.112650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:50.112937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:50.113214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:50.114441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:50.114809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:50.116645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:50.137461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 639/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Jun 23 11:46:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:50.146765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:50.247322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:50.258144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42e851-53fb-4709-9ad3-55c06fa8e2c7 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:50.293744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:50.294401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:50.294719 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:50.294968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:50.373168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:50.374665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:50.468860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:50.480444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 643/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Jun 23 11:46:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:46:50.486883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:50.558794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:50.612591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86297-b4c0-41fc-b924-3eeee82e6a0d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:50.656899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:50.657651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:50.657938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:50.658190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:50.669893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:50.671354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:46:50.690090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:50.691109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:50.692455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:46:50.692455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:46:50.692455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:46:50.692455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:50.692455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 640/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:50.700985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:50.814548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a98fdb-fac8-4562-bc8a-6568d8a5fef1 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:50.852951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:50.853630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:50.853943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:50.854223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:50.854964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:50.855265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:50.856658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:50.870055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 644/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Jun 23 11:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:50.876672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:50.990958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109989ec-d492-4d8e-af03-8751c9b175a1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:51.007685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:51.030505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:51.031308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:51.031586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:51.031844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:51.038681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:51.040161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:46:51.053579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:51.054625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 23 11:46:51.055686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 641/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Jun 23 11:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:51.060959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:51.116769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:51.174674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac6fa-788d-4ed3-b381-cb91b14a8603 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:51.210501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:51.211157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:51.211442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:51.211720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:51.212516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:51.212830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:51.214317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123cb57-1fd3-4600-b311-286ab8356fff None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:51.226736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 645/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Jun 23 11:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:51.233137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:51.346550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941207-e53a-4fb9-b08d-6355ee65292e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:51.381195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:51.381888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:51.382181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:51.382457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:51.383300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] RBAC: Adding query filter params (role.id=2702c53281284456a65007036b36070c, scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701, user.id=12a98501cfe942dda4c2c8350215bcea) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:51.383616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:51.385075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31f21-24fc-4c8e-88ae-4fd018d59e56 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:51.391231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 642/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Jun 23 11:46:51 2022] GET /identity/v3/role_assignments?user.id=12a98501cfe942dda4c2c8350215bcea&scope.project.id=0bc7763b1475407d9bf9d9bfa6a03701&role.id=2702c53281284456a65007036b36070c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:53.430303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e746-3969-4745-9014-ad428339d3ec None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:53.431181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e746-3969-4745-9014-ad428339d3ec None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:53.431181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e746-3969-4745-9014-ad428339d3ec None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:53.433213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 646/1288] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:53.441719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:53.442190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:53.442314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:53.460643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:53.461863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:53.492894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:53.536625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 643/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:53.559389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e746-3969-4745-9014-ad428339d3ec None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:53.671321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e746-3969-4745-9014-ad428339d3ec None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:53.682173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:53.707670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:53.708785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:53.708785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:53.709204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:53.709896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:53.711281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:53.723215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:53.724621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:53.726186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 647/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:46:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:53.733321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:53.853049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ac94-42c1-4a91-a555-3697ae332ebd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:53.893102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:53.893815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:53.894104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:53.894384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:53.895101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:53.895414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:53.897201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93bf86-e26b-4e2a-a921-fcb2e7890ff9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:53.902202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 644/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 23 11:46:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:53.909102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:54.029197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5fab-a2df-46c8-8263-2c6e8dfc2e37 None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:54.066161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:54.066825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:54.067111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:54.067399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] PATH_INFO: `/v3/services` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:54.068353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:54.068697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:54.070134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dede8-8488-414f-b9d2-d6f6a6c36f95 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:54.074774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 648/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 23 11:46:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:56.156179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702598e2-8cd0-43ac-bc5e-2b742c0180b0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:56.156780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702598e2-8cd0-43ac-bc5e-2b742c0180b0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:56.156780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702598e2-8cd0-43ac-bc5e-2b742c0180b0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:56.158189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 645/1293] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:56.164005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec270-c794-4712-8271-fd9c214e985a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:56.164426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec270-c794-4712-8271-fd9c214e985a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:56.164426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aec270-c794-4712-8271-fd9c214e985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:56.183451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a0aec270-c794-4712-8271-fd9c214e985a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:56.184636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a0aec270-c794-4712-8271-fd9c214e985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:56.216465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:56.268630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 649/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:56.303733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702598e2-8cd0-43ac-bc5e-2b742c0180b0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:56.339989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:56.430413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702598e2-8cd0-43ac-bc5e-2b742c0180b0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:56.466147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8117e-e680-444f-940e-759d3020ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:56.466814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8117e-e680-444f-940e-759d3020ab19 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:56.467097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8117e-e680-444f-940e-759d3020ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:56.467376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8117e-e680-444f-940e-759d3020ab19 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:56.468101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8117e-e680-444f-940e-759d3020ab19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:56.469482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8117e-e680-444f-940e-759d3020ab19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:56.485928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 646/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Jun 23 11:46:56 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:46:58.523103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba647b11-fb36-43d8-81f7-13fa0653bc02 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:58.523740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba647b11-fb36-43d8-81f7-13fa0653bc02 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:58.523740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba647b11-fb36-43d8-81f7-13fa0653bc02 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:58.525635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 650/1296] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:46:58.533326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:58.533813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:58.533920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:58.559148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:46:58.560737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:46:58.643898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 647/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:46:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:46:58.674306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba647b11-fb36-43d8-81f7-13fa0653bc02 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:58.792751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba647b11-fb36-43d8-81f7-13fa0653bc02 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:58.830888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:58.831694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:58.831980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:58.832265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:58.832927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:58.834643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:46:58.846911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:46:58.848021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:46:58.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 651/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:46:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:46:58.854929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:58.880956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:58.972961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb2447-dba4-459f-89ac-63cb3fc90f1e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:59.010320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:59.010984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:59.011262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:59.011535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:59.012248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:59.012550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:59.013961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:59.019308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 648/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 23 11:46:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:59.029916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:59.072364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:59.146968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e579b-92fc-43a6-bcfa-8917818a198d None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:59.181003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:59.181689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:59.181972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:59.182261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:59.183072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] RBAC: Adding query filter params (interface=public, service_id=10d8b644bc2141c0a08fb8acc05562a1, region_id=RegionOne) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:46:59.183389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:59.184777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da96b8-5ad0-455b-a7d6-92b3d9478fc9 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:59.189892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 652/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Jun 23 11:46:59 2022] GET /identity/v3/endpoints?service_id=10d8b644bc2141c0a08fb8acc05562a1&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:46:59.196642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:46:59.290388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:59.309772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7f18-277f-486b-a9d5-d9985a3b1b7f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:46:59.357661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff5046-84c3-4237-bf13-11b65a06257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:46:59.358261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff5046-84c3-4237-bf13-11b65a06257f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:46:59.358543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff5046-84c3-4237-bf13-11b65a06257f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:46:59.358817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff5046-84c3-4237-bf13-11b65a06257f None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:46:59.359530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff5046-84c3-4237-bf13-11b65a06257f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:46:59.360920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff5046-84c3-4237-bf13-11b65a06257f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:46:59.368442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 649/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Jun 23 11:46:59 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:47:01.439545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504866e-4340-48c4-a1b0-8820f1f7436a None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:47:01.440146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504866e-4340-48c4-a1b0-8820f1f7436a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:47:01.440146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504866e-4340-48c4-a1b0-8820f1f7436a None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:47:01.442270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 653/1302] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:47:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:47:01.450942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:47:01.451455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:47:01.451549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:47:01.472337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:47:01.473580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:47:01.544813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 650/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:47:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:47:01.568729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504866e-4340-48c4-a1b0-8820f1f7436a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:47:01.675241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:01.688196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504866e-4340-48c4-a1b0-8820f1f7436a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:47:01.727013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:47:01.727743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:47:01.728029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:47:01.728311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:47:01.728978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:47:01.730414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:47:01.743245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:47:01.744368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application with Lock( Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: ERROR keystone.server.flask.application Jun 23 11:47:01.745389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 654/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Jun 23 11:47:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:47:01.751450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:47:01.833007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:01.859036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d531f-cb15-4605-a9ed-56f614a0c3a7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:47:01.898894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:47:01.899568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:47:01.899860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:47:01.900137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:47:01.900850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:47:01.901162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:47:01.902591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa1fc-71b6-446e-926d-b1cdca5e8f72 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:47:01.908295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 651/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Jun 23 11:47:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:47:01.915923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:47:02.026034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eae62-8b4d-4432-b357-8ef37ac79a3b None admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:47:02.062020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d4246-cca5-448b-b8f3-337633d64ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:47:02.062678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d4246-cca5-448b-b8f3-337633d64ec0 None admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:47:02.062963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d4246-cca5-448b-b8f3-337633d64ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:47:02.063239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d4246-cca5-448b-b8f3-337633d64ec0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:47:02.063995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d4246-cca5-448b-b8f3-337633d64ec0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:47:02.065486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d4246-cca5-448b-b8f3-337633d64ec0 None admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:47:02.089350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 655/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Jun 23 11:47:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:47:11.904872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=30 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:12.083663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:06.417517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b5e9-57a3-4659-b797-7e10acb383f1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:06.418134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b5e9-57a3-4659-b797-7e10acb383f1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:06.418134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9b5e9-57a3-4659-b797-7e10acb383f1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:06.423481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 652/1307] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:06.424954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843867-2eb8-4164-8b12-964c4c90c5c6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:06.425419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843867-2eb8-4164-8b12-964c4c90c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:06.425682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843867-2eb8-4164-8b12-964c4c90c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:06.645402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2d843867-2eb8-4164-8b12-964c4c90c5c6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:06.650029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2d843867-2eb8-4164-8b12-964c4c90c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:06.824147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 656/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:06.877138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d446c7-90c5-4c45-94ca-8def37e62e5a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:06.877430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d446c7-90c5-4c45-94ca-8def37e62e5a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:06.878030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d446c7-90c5-4c45-94ca-8def37e62e5a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:06.879476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 653/1309] 10.222.0.27 () {54 vars in 964 bytes} [Thu Jun 23 11:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:06.885917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d711e5e-4401-4ab5-9dc7-621d1bc8f934 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:06.886201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d711e5e-4401-4ab5-9dc7-621d1bc8f934 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:06.886497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d711e5e-4401-4ab5-9dc7-621d1bc8f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:06.967614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9d711e5e-4401-4ab5-9dc7-621d1bc8f934 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:06.968818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9d711e5e-4401-4ab5-9dc7-621d1bc8f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:06.991860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:07.055500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 657/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Jun 23 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:07.064823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d446c7-90c5-4c45-94ca-8def37e62e5a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:07.067047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d6d446c7-90c5-4c45-94ca-8def37e62e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:07.188284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d446c7-90c5-4c45-94ca-8def37e62e5a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:07.272950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:07.274256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:07.274749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:07.275248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:07.277110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:07.343305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:07.411987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:07.413575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1e169-ae99-447b-994c-7ad5b7906143 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:07.436643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 654/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:09.798266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d088-537e-4c28-88ac-391565e88599 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:09.798857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d088-537e-4c28-88ac-391565e88599 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:09.798857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d088-537e-4c28-88ac-391565e88599 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:09.800328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 658/1312] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:09.806292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d425528-bad1-48c9-919d-d3b783647f45 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:09.806809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d425528-bad1-48c9-919d-d3b783647f45 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:09.806916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d425528-bad1-48c9-919d-d3b783647f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:09.894090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2d425528-bad1-48c9-919d-d3b783647f45 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:09.895314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2d425528-bad1-48c9-919d-d3b783647f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:10.005642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 655/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:10.043875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3d088-537e-4c28-88ac-391565e88599 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:10.045439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-81b3d088-537e-4c28-88ac-391565e88599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:10.158684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3d088-537e-4c28-88ac-391565e88599 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:10.231972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:10.234357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:10.235011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:10.235290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:10.235570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:10.237894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:10.357544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:10.359042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836ab8-172b-45d8-b5e5-91d30b665ece service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:10.379055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 659/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:12.752637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459654-2127-45bf-a170-ad0c63908ee7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:12.753263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459654-2127-45bf-a170-ad0c63908ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:12.753263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459654-2127-45bf-a170-ad0c63908ee7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:12.754586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 656/1315] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:12.761089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89cd8-cfe0-427f-8b3a-a77a019046d1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:12.761557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89cd8-cfe0-427f-8b3a-a77a019046d1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:12.761736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89cd8-cfe0-427f-8b3a-a77a019046d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:12.846790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-66a89cd8-cfe0-427f-8b3a-a77a019046d1 None None] MFA Rules not processed for user `576d89f5c5a645ba8a5a64a598301ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:12.848019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-66a89cd8-cfe0-427f-8b3a-a77a019046d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:12.906071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:12.955566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 660/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:13.016138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdde26-1abd-44cc-9aef-82a3130757e1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:13.016429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdde26-1abd-44cc-9aef-82a3130757e1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:13.016708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdde26-1abd-44cc-9aef-82a3130757e1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:13.018183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 657/1317] 10.222.0.27 () {54 vars in 964 bytes} [Thu Jun 23 11:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:13.027981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3d3f-5aeb-479b-ad8a-40af07086fe2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:13.028355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3d3f-5aeb-479b-ad8a-40af07086fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:13.028750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3d3f-5aeb-479b-ad8a-40af07086fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:13.111792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-44eb3d3f-5aeb-479b-ad8a-40af07086fe2 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:13.113155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-44eb3d3f-5aeb-479b-ad8a-40af07086fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:13.191367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 661/1318] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Jun 23 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:13.205965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdde26-1abd-44cc-9aef-82a3130757e1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:13.208314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fefdde26-1abd-44cc-9aef-82a3130757e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:13.219370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:13.317224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdde26-1abd-44cc-9aef-82a3130757e1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:13.395775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:13.396421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:13.396698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:13.396968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:13.398780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:13.466845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:13.518253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:13.519719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac696f-6967-4cdb-9fc2-e67c09599085 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:13.540350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 658/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:16.577580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d51fa-c991-4c5f-9d77-d378cda9b9b3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:16.578516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d51fa-c991-4c5f-9d77-d378cda9b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:16.578516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d51fa-c991-4c5f-9d77-d378cda9b9b3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:16.580781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 662/1320] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:16.589640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96f7d-926f-4676-9988-4855528d5660 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:16.590345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96f7d-926f-4676-9988-4855528d5660 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:16.590525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96f7d-926f-4676-9988-4855528d5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:16.667014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e2b96f7d-926f-4676-9988-4855528d5660 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:16.668231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e2b96f7d-926f-4676-9988-4855528d5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:16.773564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 659/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:16.816017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d51fa-c991-4c5f-9d77-d378cda9b9b3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:16.818538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fd7d51fa-c991-4c5f-9d77-d378cda9b9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:16.874005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:16.940901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d51fa-c991-4c5f-9d77-d378cda9b9b3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:17.029630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:17.030300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:17.030589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:17.030842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:17.032578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:17.136021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:17.150667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:17.152139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497608fe-0098-47be-ad8e-53ea2c3b063e service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:17.171210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 663/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:20.057949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa6ce-4d6b-401e-a40b-027c62af483b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:20.058494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa6ce-4d6b-401e-a40b-027c62af483b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:20.058494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa6ce-4d6b-401e-a40b-027c62af483b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:20.059949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 660/1323] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:20.065469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17bd12-1bd5-4084-b7ec-ee292871c003 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:20.065988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17bd12-1bd5-4084-b7ec-ee292871c003 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:20.066104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17bd12-1bd5-4084-b7ec-ee292871c003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:20.135138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5b17bd12-1bd5-4084-b7ec-ee292871c003 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:20.136345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5b17bd12-1bd5-4084-b7ec-ee292871c003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:20.248637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 664/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:20.286787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa6ce-4d6b-401e-a40b-027c62af483b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:20.289789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bd9fa6ce-4d6b-401e-a40b-027c62af483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:20.312762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:20.414829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa6ce-4d6b-401e-a40b-027c62af483b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:20.491654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:20.492314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:20.492601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:20.492864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:20.494556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:20.573471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:20.614971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:20.616516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918e4c2-6c0b-48da-82cf-db6164a0820c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:20.635602 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 661/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:22.742653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c33d5-b86b-442e-bcee-b9639992dddc None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:22.743212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c33d5-b86b-442e-bcee-b9639992dddc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:22.743212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c33d5-b86b-442e-bcee-b9639992dddc None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:22.744617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 665/1326] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:22.750075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720322a-431c-4525-9d35-c001bc7d16e5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:22.750560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720322a-431c-4525-9d35-c001bc7d16e5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:22.750664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720322a-431c-4525-9d35-c001bc7d16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:22.823303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4720322a-431c-4525-9d35-c001bc7d16e5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:22.824416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4720322a-431c-4525-9d35-c001bc7d16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:22.933645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 662/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:22.966943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c33d5-b86b-442e-bcee-b9639992dddc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:22.968505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-806c33d5-b86b-442e-bcee-b9639992dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:23.039678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:23.090929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c33d5-b86b-442e-bcee-b9639992dddc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:23.172666 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:23.173335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:23.173670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:23.173979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:23.175741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:23.297095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:23.299688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:23.301815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c3a86-70d7-497e-9397-f7794d41ce99 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:23.323455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 666/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:25.457853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f150-e6bb-4454-af7f-49e3a5cb44f8 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:25.458465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f150-e6bb-4454-af7f-49e3a5cb44f8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:25.458465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f150-e6bb-4454-af7f-49e3a5cb44f8 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:25.459815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 663/1329] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:25.465410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1e00e-c5b5-4461-a051-3845a9c971f6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:25.465916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1e00e-c5b5-4461-a051-3845a9c971f6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:25.466007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1e00e-c5b5-4461-a051-3845a9c971f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:25.538223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-95b1e00e-c5b5-4461-a051-3845a9c971f6 None None] MFA Rules not processed for user `576d89f5c5a645ba8a5a64a598301ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:25.539766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-95b1e00e-c5b5-4461-a051-3845a9c971f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:25.652156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 667/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:25.690604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f150-e6bb-4454-af7f-49e3a5cb44f8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:25.692155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e481f150-e6bb-4454-af7f-49e3a5cb44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:25.725726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:25.800487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f150-e6bb-4454-af7f-49e3a5cb44f8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:25.880631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:25.881283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:25.881561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:25.881894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:25.883526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:25.962833 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:26.015369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:26.016835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d32c8-53d7-4cae-a022-611bd0b7c2a1 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:26.037154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 664/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:28.405855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab0ff-b29c-4fc1-984d-2642eaf79b83 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:28.406411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab0ff-b29c-4fc1-984d-2642eaf79b83 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:28.406411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab0ff-b29c-4fc1-984d-2642eaf79b83 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:28.407811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 668/1332] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:28.413258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb736-b0f2-47ff-873c-42050d647e01 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:28.413736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb736-b0f2-47ff-873c-42050d647e01 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:28.413832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb736-b0f2-47ff-873c-42050d647e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:28.498199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2ddcb736-b0f2-47ff-873c-42050d647e01 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:28.499322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2ddcb736-b0f2-47ff-873c-42050d647e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:28.610158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 665/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:28.656523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ab0ff-b29c-4fc1-984d-2642eaf79b83 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:28.658168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-431ab0ff-b29c-4fc1-984d-2642eaf79b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:28.731953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:28.769451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ab0ff-b29c-4fc1-984d-2642eaf79b83 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:28.848405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:28.849050 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:28.849329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:28.849639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:28.851476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:28.973869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:28.975335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75188a93-6293-44b8-b3bc-2d2c07beb2a8 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:28.992105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:29.001557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 669/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:31.046715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96521-72ff-43d6-ad74-24efff8487f6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:31.047308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96521-72ff-43d6-ad74-24efff8487f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:31.047308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96521-72ff-43d6-ad74-24efff8487f6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:31.048643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 666/1335] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:31.055809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0f5c-423e-437d-a839-d46a428fdf66 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:31.056511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0f5c-423e-437d-a839-d46a428fdf66 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:31.056628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e0f5c-423e-437d-a839-d46a428fdf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:31.133199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1b6e0f5c-423e-437d-a839-d46a428fdf66 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:31.134463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1b6e0f5c-423e-437d-a839-d46a428fdf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:31.246255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 670/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:31.299144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96521-72ff-43d6-ad74-24efff8487f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:31.301672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-36e96521-72ff-43d6-ad74-24efff8487f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:31.347794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:31.420487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96521-72ff-43d6-ad74-24efff8487f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:31.505302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:31.505998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:31.506285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:31.506653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:31.508842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:31.608353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:31.645177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:31.646697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925a77c-367a-4bfa-bec6-e1329fbe9a1d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:31.668537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 667/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:34.194988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b8fc-5fc9-4798-8daa-2e82da1ec0c3 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:34.195490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b8fc-5fc9-4798-8daa-2e82da1ec0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:34.195617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b8fc-5fc9-4798-8daa-2e82da1ec0c3 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:34.196985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 671/1338] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:34.204086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84562be3-ee98-4424-a1e8-65478d468439 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:34.204515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84562be3-ee98-4424-a1e8-65478d468439 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:34.204625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84562be3-ee98-4424-a1e8-65478d468439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:34.272544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-84562be3-ee98-4424-a1e8-65478d468439 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:34.273794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84562be3-ee98-4424-a1e8-65478d468439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:34.384557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 668/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:34.420789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888b8fc-5fc9-4798-8daa-2e82da1ec0c3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:34.422383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0888b8fc-5fc9-4798-8daa-2e82da1ec0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:34.510168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:34.544715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888b8fc-5fc9-4798-8daa-2e82da1ec0c3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:34.621840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:34.622500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:34.622784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:34.623056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:34.624801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:34.741319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:34.742812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e0806-f749-4b79-8b53-3ddabfdc5cb2 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:34.762488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 672/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:38.981806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2974-007c-4519-b364-4ad3f5b20e95 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:38.982830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2974-007c-4519-b364-4ad3f5b20e95 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:38.983452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2974-007c-4519-b364-4ad3f5b20e95 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:38.985026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 669/1341] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:38.990904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf79b-069f-445c-b22a-436d71edcb61 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:38.991384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf79b-069f-445c-b22a-436d71edcb61 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:38.991528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf79b-069f-445c-b22a-436d71edcb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:38.999011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:39.074697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e6dcf79b-069f-445c-b22a-436d71edcb61 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:39.075909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e6dcf79b-069f-445c-b22a-436d71edcb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:39.194981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 673/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:39.233108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2974-007c-4519-b364-4ad3f5b20e95 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:39.235563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-084d2974-007c-4519-b364-4ad3f5b20e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:39.289017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:39.338564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2974-007c-4519-b364-4ad3f5b20e95 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:39.342498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2c534-19d3-4730-ab8b-2a36c0e35126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:39.343148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c534-19d3-4730-ab8b-2a36c0e35126 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:39.343453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c534-19d3-4730-ab8b-2a36c0e35126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:39.343755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c534-19d3-4730-ab8b-2a36c0e35126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:39.353932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2c534-19d3-4730-ab8b-2a36c0e35126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:39.355597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2c534-19d3-4730-ab8b-2a36c0e35126 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:39.366920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 670/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:48:42.029422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73a4b-36f2-443d-a700-c282c62bf0a4 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:42.030017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73a4b-36f2-443d-a700-c282c62bf0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:42.030017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73a4b-36f2-443d-a700-c282c62bf0a4 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:42.031395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 674/1344] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:42.036809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7355ef4-8c3e-4a7f-b789-56dd150c0bdf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:42.037214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7355ef4-8c3e-4a7f-b789-56dd150c0bdf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:42.037398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7355ef4-8c3e-4a7f-b789-56dd150c0bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:42.068214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7355ef4-8c3e-4a7f-b789-56dd150c0bdf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:42.069943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7355ef4-8c3e-4a7f-b789-56dd150c0bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:42.158085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 671/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:42.196614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73a4b-36f2-443d-a700-c282c62bf0a4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:42.198628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cae73a4b-36f2-443d-a700-c282c62bf0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:42.213992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73a4b-36f2-443d-a700-c282c62bf0a4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:42.217992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cef1f6-c609-40e5-858b-a30aed9769cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:42.218761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cef1f6-c609-40e5-858b-a30aed9769cc service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:42.219140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cef1f6-c609-40e5-858b-a30aed9769cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:42.219489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cef1f6-c609-40e5-858b-a30aed9769cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:42.230498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cef1f6-c609-40e5-858b-a30aed9769cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:42.232098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cef1f6-c609-40e5-858b-a30aed9769cc service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:42.243848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 675/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:46.549573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd78f2-809b-4017-9161-1e7f7a37da0a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:46.550161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd78f2-809b-4017-9161-1e7f7a37da0a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:46.550161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd78f2-809b-4017-9161-1e7f7a37da0a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:46.551694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 672/1347] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:48:46.558082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb0de-469f-4910-9570-f28e74511a5e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:46.558082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb0de-469f-4910-9570-f28e74511a5e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:46.558683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb0de-469f-4910-9570-f28e74511a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:46.579461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-198cb0de-469f-4910-9570-f28e74511a5e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:46.580742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-198cb0de-469f-4910-9570-f28e74511a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:46.589467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 676/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:46.628729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd78f2-809b-4017-9161-1e7f7a37da0a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:48:46.640246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd78f2-809b-4017-9161-1e7f7a37da0a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:48:46.644019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf24b-6a7c-40ba-ac04-b42a6529f882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:48:46.644717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf24b-6a7c-40ba-ac04-b42a6529f882 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:46.645059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf24b-6a7c-40ba-ac04-b42a6529f882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:46.645396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf24b-6a7c-40ba-ac04-b42a6529f882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:46.655132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cf24b-6a7c-40ba-ac04-b42a6529f882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:48:46.656800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cf24b-6a7c-40ba-ac04-b42a6529f882 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:48:46.667953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 673/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:51.799646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a77b-4021-49b3-9712-7110c8faa036 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:51.800473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a77b-4021-49b3-9712-7110c8faa036 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:51.800916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61a77b-4021-49b3-9712-7110c8faa036 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:51.804308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 677/1350] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:48:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:51.811356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e821d-2552-4ca2-8deb-c23bb11642c0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:51.811813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e821d-2552-4ca2-8deb-c23bb11642c0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:51.812034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e821d-2552-4ca2-8deb-c23bb11642c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:51.895380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ca6e821d-2552-4ca2-8deb-c23bb11642c0 None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:51.896834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ca6e821d-2552-4ca2-8deb-c23bb11642c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:51.925953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:51.981027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 674/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:48:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:56.141174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89e68-f3f3-4b42-9377-a7228d116998 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:56.142096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89e68-f3f3-4b42-9377-a7228d116998 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:56.142096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89e68-f3f3-4b42-9377-a7228d116998 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:56.143491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 678/1352] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:56.148960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9931-e54d-495e-944a-1992131df9db None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:56.149436 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9931-e54d-495e-944a-1992131df9db None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:56.149521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9931-e54d-495e-944a-1992131df9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:56.170214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-679e9931-e54d-495e-944a-1992131df9db None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:56.171530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-679e9931-e54d-495e-944a-1992131df9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:56.182038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 675/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:48:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:48:56.573367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=72 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:57.750859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4efe99-d291-4090-9cde-41d205456bef None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:57.751382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4efe99-d291-4090-9cde-41d205456bef None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:57.751382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4efe99-d291-4090-9cde-41d205456bef None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:57.752809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 679/1354] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:48:57.758835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb27a-b728-4acf-bc0a-e45dc4eda122 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:48:57.759306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb27a-b728-4acf-bc0a-e45dc4eda122 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:48:57.759424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cb27a-b728-4acf-bc0a-e45dc4eda122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:48:57.778653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-be9cb27a-b728-4acf-bc0a-e45dc4eda122 None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:48:57.779869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-be9cb27a-b728-4acf-bc0a-e45dc4eda122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:48:57.790321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 676/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:48:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:01.372848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b750b-456b-48d7-b750-a966227a811e None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:01.373380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b750b-456b-48d7-b750-a966227a811e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:01.373380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b750b-456b-48d7-b750-a966227a811e None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:01.375854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 680/1356] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:01.381838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4cf5-39a0-4132-ac49-c3853cc55861 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:01.382719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4cf5-39a0-4132-ac49-c3853cc55861 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:01.383198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4cf5-39a0-4132-ac49-c3853cc55861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:01.404653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-89ab4cf5-39a0-4132-ac49-c3853cc55861 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:01.406508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89ab4cf5-39a0-4132-ac49-c3853cc55861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:01.415369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 677/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:01.474188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139ab7-7285-4b4b-b680-a67b7c3cedb8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:01.474988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139ab7-7285-4b4b-b680-a67b7c3cedb8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:01.475472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139ab7-7285-4b4b-b680-a67b7c3cedb8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:01.477920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 681/1358] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 23 11:49:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:01.485641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04a8f-3950-47f9-808b-7cb5300d6acc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:01.486363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04a8f-3950-47f9-808b-7cb5300d6acc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:01.487089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04a8f-3950-47f9-808b-7cb5300d6acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:01.547017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-54f04a8f-3950-47f9-808b-7cb5300d6acc None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:01.548226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-54f04a8f-3950-47f9-808b-7cb5300d6acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:01.649933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 678/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 23 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:01.654234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139ab7-7285-4b4b-b680-a67b7c3cedb8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:01.670870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139ab7-7285-4b4b-b680-a67b7c3cedb8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:01.676598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa016-4fb0-456f-8320-d325e5fee153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:01.677261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa016-4fb0-456f-8320-d325e5fee153 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:01.677547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa016-4fb0-456f-8320-d325e5fee153 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:01.677911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa016-4fb0-456f-8320-d325e5fee153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:01.687148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fa016-4fb0-456f-8320-d325e5fee153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:01.688751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fa016-4fb0-456f-8320-d325e5fee153 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:01.700112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 682/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:03.942848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8dae5-f748-4dba-b621-5615ac11e53d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:03.943520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8dae5-f748-4dba-b621-5615ac11e53d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:03.943520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8dae5-f748-4dba-b621-5615ac11e53d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:03.945197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 679/1361] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:03.950746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b786af-1561-42b0-96c5-2fc35618dcde None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:03.951226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b786af-1561-42b0-96c5-2fc35618dcde None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:03.951323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b786af-1561-42b0-96c5-2fc35618dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:03.970790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-16b786af-1561-42b0-96c5-2fc35618dcde None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:03.972231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-16b786af-1561-42b0-96c5-2fc35618dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:03.983626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 683/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:04.027282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8dae5-f748-4dba-b621-5615ac11e53d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:04.044567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8dae5-f748-4dba-b621-5615ac11e53d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:04.050696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bd124-84e5-4fef-9bba-635b1753540c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:04.051458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bd124-84e5-4fef-9bba-635b1753540c service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:04.051839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bd124-84e5-4fef-9bba-635b1753540c service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:04.052215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bd124-84e5-4fef-9bba-635b1753540c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:04.061759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bd124-84e5-4fef-9bba-635b1753540c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:04.063480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bd124-84e5-4fef-9bba-635b1753540c service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:04.075633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 680/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:06.410954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac3d7-07cc-4140-a639-e0995dc02023 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:06.411539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac3d7-07cc-4140-a639-e0995dc02023 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:06.411539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac3d7-07cc-4140-a639-e0995dc02023 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:06.413150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 684/1364] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:06.421379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631da404-3fe5-4160-b490-ac9cbbe32bfb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:06.422047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631da404-3fe5-4160-b490-ac9cbbe32bfb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:06.422047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631da404-3fe5-4160-b490-ac9cbbe32bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:06.443010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-631da404-3fe5-4160-b490-ac9cbbe32bfb None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:06.444247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-631da404-3fe5-4160-b490-ac9cbbe32bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:06.452525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 681/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:06.499704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087f8c-4cd9-4616-99a1-519f95cbf7cc None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:06.500085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087f8c-4cd9-4616-99a1-519f95cbf7cc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:06.500443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe087f8c-4cd9-4616-99a1-519f95cbf7cc None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:06.501946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 685/1366] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 23 11:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:06.508566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7d54-14b8-4bcc-a57e-4260ea590621 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:06.509012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7d54-14b8-4bcc-a57e-4260ea590621 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:06.509425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7d54-14b8-4bcc-a57e-4260ea590621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:06.528961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-06cc7d54-14b8-4bcc-a57e-4260ea590621 None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:06.530206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-06cc7d54-14b8-4bcc-a57e-4260ea590621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:06.549740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087f8c-4cd9-4616-99a1-519f95cbf7cc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:06.551465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 682/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 23 11:49:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:06.571312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe087f8c-4cd9-4616-99a1-519f95cbf7cc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:06.577200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c821d1-3aa2-44fe-a25c-849658847cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:06.578164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c821d1-3aa2-44fe-a25c-849658847cc5 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:06.578669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c821d1-3aa2-44fe-a25c-849658847cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:06.579151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c821d1-3aa2-44fe-a25c-849658847cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:06.588906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c821d1-3aa2-44fe-a25c-849658847cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:06.590893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c821d1-3aa2-44fe-a25c-849658847cc5 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:06.601355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 686/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:49:09.018191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65049c7-ddf4-4efc-b76d-9b31d22ef94b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.018754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65049c7-ddf4-4efc-b76d-9b31d22ef94b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.018754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65049c7-ddf4-4efc-b76d-9b31d22ef94b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.020133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 683/1369] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:09.025797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734ea53-41d2-41fd-bab2-4e72286a9f10 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.026273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734ea53-41d2-41fd-bab2-4e72286a9f10 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.026682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734ea53-41d2-41fd-bab2-4e72286a9f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.046435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7734ea53-41d2-41fd-bab2-4e72286a9f10 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:09.047819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7734ea53-41d2-41fd-bab2-4e72286a9f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:09.057465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 687/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:09.100407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65049c7-ddf4-4efc-b76d-9b31d22ef94b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:09.115286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65049c7-ddf4-4efc-b76d-9b31d22ef94b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:09.120801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9db16-4f44-4778-9784-0eb39b8fdfa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:09.121462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9db16-4f44-4778-9784-0eb39b8fdfa5 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.121783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9db16-4f44-4778-9784-0eb39b8fdfa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.122067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9db16-4f44-4778-9784-0eb39b8fdfa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.130772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9db16-4f44-4778-9784-0eb39b8fdfa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:09.132406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9db16-4f44-4778-9784-0eb39b8fdfa5 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:09.142820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 684/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:09.589293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af69d-3257-4c92-854a-0d0a0ae6e5fe None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.589580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af69d-3257-4c92-854a-0d0a0ae6e5fe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.589893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af69d-3257-4c92-854a-0d0a0ae6e5fe None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.592296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 688/1372] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:09.598117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc785-5aa7-46f6-9688-3e755311fcaf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.598407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc785-5aa7-46f6-9688-3e755311fcaf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.598850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc785-5aa7-46f6-9688-3e755311fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.622524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d3dcc785-5aa7-46f6-9688-3e755311fcaf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:09.623736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d3dcc785-5aa7-46f6-9688-3e755311fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:09.633650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 685/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:49:09.979681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31419d60-0c52-48e4-8f10-a89955f795d2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.979681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31419d60-0c52-48e4-8f10-a89955f795d2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.979681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31419d60-0c52-48e4-8f10-a89955f795d2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.980564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 689/1374] 10.222.0.27 () {54 vars in 963 bytes} [Thu Jun 23 11:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:09.985421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d3f5-b70a-4633-91fd-39baa2cebdbc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:09.985859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d3f5-b70a-4633-91fd-39baa2cebdbc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:09.986104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d3f5-b70a-4633-91fd-39baa2cebdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:09.995222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:10.040237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3e94d3f5-b70a-4633-91fd-39baa2cebdbc None None] MFA Rules not processed for user `57ae4c65d3be47eeb52566dec6cb286c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:10.041576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e94d3f5-b70a-4633-91fd-39baa2cebdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:10.106900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 686/1375] 10.222.0.27 () {58 vars in 1060 bytes} [Thu Jun 23 11:49:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:10.114848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31419d60-0c52-48e4-8f10-a89955f795d2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:10.126329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31419d60-0c52-48e4-8f10-a89955f795d2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:10.130154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba3e0a-bd54-4159-851b-37d1b2824b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:10.130960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba3e0a-bd54-4159-851b-37d1b2824b2d service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:10.131513 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba3e0a-bd54-4159-851b-37d1b2824b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:10.131798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba3e0a-bd54-4159-851b-37d1b2824b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:10.142170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba3e0a-bd54-4159-851b-37d1b2824b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:10.143640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba3e0a-bd54-4159-851b-37d1b2824b2d service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:10.154507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 690/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:11.218010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b45ce7-a138-46e7-96e0-b53966668da6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:11.218553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b45ce7-a138-46e7-96e0-b53966668da6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:11.218553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b45ce7-a138-46e7-96e0-b53966668da6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:11.219897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 687/1377] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:11.225358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8693d-b08f-457d-abbb-4af5ffdcd0f4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:11.225844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8693d-b08f-457d-abbb-4af5ffdcd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:11.226074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8693d-b08f-457d-abbb-4af5ffdcd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:11.244873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6ad8693d-b08f-457d-abbb-4af5ffdcd0f4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:11.246111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6ad8693d-b08f-457d-abbb-4af5ffdcd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:11.254768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 691/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:11.300581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b45ce7-a138-46e7-96e0-b53966668da6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:11.317343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b45ce7-a138-46e7-96e0-b53966668da6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:11.325116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e26e84-77ed-49c7-b8a4-268fa2101948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:11.325831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e26e84-77ed-49c7-b8a4-268fa2101948 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:11.326123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e26e84-77ed-49c7-b8a4-268fa2101948 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:11.326405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e26e84-77ed-49c7-b8a4-268fa2101948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:11.335603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e26e84-77ed-49c7-b8a4-268fa2101948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:11.337213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e26e84-77ed-49c7-b8a4-268fa2101948 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:11.347421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 688/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:13.419334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7deb1-0c3b-4aa7-a081-dd8c647e3cdb None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:13.419974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7deb1-0c3b-4aa7-a081-dd8c647e3cdb None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:13.419974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7deb1-0c3b-4aa7-a081-dd8c647e3cdb None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:13.421260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 692/1380] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:13.426540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794522-0084-4b8d-bd0b-632ac76cacbd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:13.427018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794522-0084-4b8d-bd0b-632ac76cacbd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:13.427129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794522-0084-4b8d-bd0b-632ac76cacbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:13.447691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-65794522-0084-4b8d-bd0b-632ac76cacbd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:13.448928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65794522-0084-4b8d-bd0b-632ac76cacbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:13.457651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 689/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:13.502266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7deb1-0c3b-4aa7-a081-dd8c647e3cdb None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:13.518415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7deb1-0c3b-4aa7-a081-dd8c647e3cdb None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:13.524105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560a4e-1b73-4e58-babc-53203305ba76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:13.524759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560a4e-1b73-4e58-babc-53203305ba76 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:13.525046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560a4e-1b73-4e58-babc-53203305ba76 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:13.525327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560a4e-1b73-4e58-babc-53203305ba76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:13.535777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560a4e-1b73-4e58-babc-53203305ba76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:13.537809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560a4e-1b73-4e58-babc-53203305ba76 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:13.548482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 693/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:15.642967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a3234-b060-45ef-a3b2-169cd93e4dc2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:15.643539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a3234-b060-45ef-a3b2-169cd93e4dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:15.643754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a3234-b060-45ef-a3b2-169cd93e4dc2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:15.645325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 690/1383] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:15.651123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ac23d-3438-48eb-9ccf-85f04fba273c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:15.651635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ac23d-3438-48eb-9ccf-85f04fba273c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:15.651635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ac23d-3438-48eb-9ccf-85f04fba273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:15.671009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3b9ac23d-3438-48eb-9ccf-85f04fba273c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:15.672198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3b9ac23d-3438-48eb-9ccf-85f04fba273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:15.681348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 694/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:15.723227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a3234-b060-45ef-a3b2-169cd93e4dc2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:15.741345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a3234-b060-45ef-a3b2-169cd93e4dc2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:15.747942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defe2f5-43bc-4ce5-9ffb-fd9680f70f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:15.748827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defe2f5-43bc-4ce5-9ffb-fd9680f70f7f service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:15.749195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defe2f5-43bc-4ce5-9ffb-fd9680f70f7f service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:15.749637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defe2f5-43bc-4ce5-9ffb-fd9680f70f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:15.761185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defe2f5-43bc-4ce5-9ffb-fd9680f70f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:15.763191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defe2f5-43bc-4ce5-9ffb-fd9680f70f7f service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:15.776215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 691/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:17.828938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d415-ebb5-45a3-a2b6-da29c1c628f8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:17.829657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d415-ebb5-45a3-a2b6-da29c1c628f8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:17.829657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d415-ebb5-45a3-a2b6-da29c1c628f8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:17.831508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 695/1386] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:17.840337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e759-db76-4626-a96c-92490e7a822c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:17.840849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e759-db76-4626-a96c-92490e7a822c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:17.841039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57e759-db76-4626-a96c-92490e7a822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:17.864012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ac57e759-db76-4626-a96c-92490e7a822c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:17.865745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ac57e759-db76-4626-a96c-92490e7a822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:17.875565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 692/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:17.923554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d415-ebb5-45a3-a2b6-da29c1c628f8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:17.941608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d415-ebb5-45a3-a2b6-da29c1c628f8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:17.947271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0e540-7909-44e1-83f1-141b0422fc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:17.947923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e540-7909-44e1-83f1-141b0422fc2b service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:17.948212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e540-7909-44e1-83f1-141b0422fc2b service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:17.948498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e540-7909-44e1-83f1-141b0422fc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:17.957715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0e540-7909-44e1-83f1-141b0422fc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:17.959383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0e540-7909-44e1-83f1-141b0422fc2b service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:17.969702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 696/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:20.057057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b6d4c-55f2-4f35-9de4-e6465a323a09 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:20.057696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b6d4c-55f2-4f35-9de4-e6465a323a09 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:20.057696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b6d4c-55f2-4f35-9de4-e6465a323a09 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:20.059040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 693/1389] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:20.064773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b12b6-4ef9-473a-a4aa-0c79ffffac53 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:20.065437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b12b6-4ef9-473a-a4aa-0c79ffffac53 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:20.065437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b12b6-4ef9-473a-a4aa-0c79ffffac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:20.085433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-511b12b6-4ef9-473a-a4aa-0c79ffffac53 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:20.086678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-511b12b6-4ef9-473a-a4aa-0c79ffffac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:20.096667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 697/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:20.142749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b6d4c-55f2-4f35-9de4-e6465a323a09 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:20.159665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b6d4c-55f2-4f35-9de4-e6465a323a09 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:20.165745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11707f3-6fe8-4601-b47d-a3a90d6ce45d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:20.166403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11707f3-6fe8-4601-b47d-a3a90d6ce45d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:20.166726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11707f3-6fe8-4601-b47d-a3a90d6ce45d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:20.166969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11707f3-6fe8-4601-b47d-a3a90d6ce45d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:20.176174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11707f3-6fe8-4601-b47d-a3a90d6ce45d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:20.178070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11707f3-6fe8-4601-b47d-a3a90d6ce45d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:20.188130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 694/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:22.997640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af82e1-dcaf-48de-9e79-7b62591902d1 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:22.998242 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af82e1-dcaf-48de-9e79-7b62591902d1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:22.998341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af82e1-dcaf-48de-9e79-7b62591902d1 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:23.000255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 698/1392] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:23.008592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02567-9e33-4f28-8f68-7df728adba27 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:23.009333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02567-9e33-4f28-8f68-7df728adba27 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:23.009333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02567-9e33-4f28-8f68-7df728adba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:23.033016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-09d02567-9e33-4f28-8f68-7df728adba27 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:23.034502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-09d02567-9e33-4f28-8f68-7df728adba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:23.043149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 695/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:23.094095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af82e1-dcaf-48de-9e79-7b62591902d1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:23.119696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af82e1-dcaf-48de-9e79-7b62591902d1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:23.126883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7b7d4-5f0e-47d1-9a29-c484562989b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:23.127957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7b7d4-5f0e-47d1-9a29-c484562989b4 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:23.129564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7b7d4-5f0e-47d1-9a29-c484562989b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:23.129564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7b7d4-5f0e-47d1-9a29-c484562989b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:23.146783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7b7d4-5f0e-47d1-9a29-c484562989b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:23.148878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7b7d4-5f0e-47d1-9a29-c484562989b4 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:23.184407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 699/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:25.322952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c10-6809-4499-ac57-516a8870f966 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.323632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c10-6809-4499-ac57-516a8870f966 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.323632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c10-6809-4499-ac57-516a8870f966 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.324909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 696/1395] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:25.330419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ef9d-63fa-4309-979e-b23be3a63478 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.330891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ef9d-63fa-4309-979e-b23be3a63478 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.330993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7ef9d-63fa-4309-979e-b23be3a63478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.350040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d2a7ef9d-63fa-4309-979e-b23be3a63478 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:25.351274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d2a7ef9d-63fa-4309-979e-b23be3a63478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:25.359420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 700/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:25.405301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994c10-6809-4499-ac57-516a8870f966 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:25.420551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994c10-6809-4499-ac57-516a8870f966 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:25.426101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3348f-5c62-4f5f-8158-ab3ab97825e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:25.426759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3348f-5c62-4f5f-8158-ab3ab97825e7 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.427117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3348f-5c62-4f5f-8158-ab3ab97825e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.427461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3348f-5c62-4f5f-8158-ab3ab97825e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.436275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3348f-5c62-4f5f-8158-ab3ab97825e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:25.437896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3348f-5c62-4f5f-8158-ab3ab97825e7 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:25.448025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 697/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:25.457098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd973-7e99-4d14-99fe-67d565366f10 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.457389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd973-7e99-4d14-99fe-67d565366f10 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.457725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd973-7e99-4d14-99fe-67d565366f10 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.459419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 701/1398] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:25.465149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ccae3-49f0-4c4f-a95c-57a460c2e0c1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.465445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ccae3-49f0-4c4f-a95c-57a460c2e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.465744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ccae3-49f0-4c4f-a95c-57a460c2e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.483849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-195ccae3-49f0-4c4f-a95c-57a460c2e0c1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:25.485060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-195ccae3-49f0-4c4f-a95c-57a460c2e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:25.493671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 698/1399] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:25.553909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f42bf-39ba-44e3-85b8-cf929225a5a6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.554346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f42bf-39ba-44e3-85b8-cf929225a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.554806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f42bf-39ba-44e3-85b8-cf929225a5a6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.556275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 702/1400] 10.222.0.27 () {54 vars in 962 bytes} [Thu Jun 23 11:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:25.562262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c86c-9375-401c-bf04-3e52d8e9b1b8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.562559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c86c-9375-401c-bf04-3e52d8e9b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.562832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c86c-9375-401c-bf04-3e52d8e9b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.624072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fe93c86c-9375-401c-bf04-3e52d8e9b1b8 None None] MFA Rules not processed for user `211375edc5774281947e0b47714a1a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:25.625692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fe93c86c-9375-401c-bf04-3e52d8e9b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:25.663201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:25.695213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 699/1401] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Jun 23 11:49:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:25.702954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f42bf-39ba-44e3-85b8-cf929225a5a6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:25.714749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f42bf-39ba-44e3-85b8-cf929225a5a6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:25.718442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294a6b2-0bab-4d45-a7a7-c8d003201166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:25.719084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a6b2-0bab-4d45-a7a7-c8d003201166 service glance] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:25.719369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a6b2-0bab-4d45-a7a7-c8d003201166 service glance] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:25.719643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a6b2-0bab-4d45-a7a7-c8d003201166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:25.729328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294a6b2-0bab-4d45-a7a7-c8d003201166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:25.730842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294a6b2-0bab-4d45-a7a7-c8d003201166 service glance] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:25.741189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 703/1402] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:26.503414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9fc4c-2dd0-45c0-8526-bda7d7683004 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:26.503927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9fc4c-2dd0-45c0-8526-bda7d7683004 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:26.504106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9fc4c-2dd0-45c0-8526-bda7d7683004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:26.558827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-87c9fc4c-2dd0-45c0-8526-bda7d7683004 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:26.560219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87c9fc4c-2dd0-45c0-8526-bda7d7683004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:26.633145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 700/1403] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:26.680062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655e12-bb8f-4f02-8d9f-e3735e376109 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:26.680610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655e12-bb8f-4f02-8d9f-e3735e376109 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:26.681033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655e12-bb8f-4f02-8d9f-e3735e376109 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:26.683628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 704/1404] 10.222.0.27 () {54 vars in 942 bytes} [Thu Jun 23 11:49:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:26.690664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fcdf8-4ded-46f7-a436-cf9de3e84eb7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:26.690964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fcdf8-4ded-46f7-a436-cf9de3e84eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:26.691256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fcdf8-4ded-46f7-a436-cf9de3e84eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:26.742011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-300fcdf8-4ded-46f7-a436-cf9de3e84eb7 None None] MFA Rules not processed for user `d2cc01f5555e4fdea9b883ab08c31acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:26.743143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-300fcdf8-4ded-46f7-a436-cf9de3e84eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:26.817719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 701/1405] 10.222.0.27 () {58 vars in 1039 bytes} [Thu Jun 23 11:49:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:26.827094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655e12-bb8f-4f02-8d9f-e3735e376109 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:26.835261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=61 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:26.842512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655e12-bb8f-4f02-8d9f-e3735e376109 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:26.847668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d89b3-6290-4d03-ab57-4c0f3cbd8dcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:26.848315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d89b3-6290-4d03-ab57-4c0f3cbd8dcc service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:26.848595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d89b3-6290-4d03-ab57-4c0f3cbd8dcc service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:26.849254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d89b3-6290-4d03-ab57-4c0f3cbd8dcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:26.857684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d89b3-6290-4d03-ab57-4c0f3cbd8dcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:26.859278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d89b3-6290-4d03-ab57-4c0f3cbd8dcc service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:26.868717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 705/1406] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:49:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:49:27.572503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0f04-2446-4a86-9a2e-3aeafe0c2aa5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:27.573097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0f04-2446-4a86-9a2e-3aeafe0c2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:27.573097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0f04-2446-4a86-9a2e-3aeafe0c2aa5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:27.574693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 702/1407] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:27.579991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd2133-a33d-4a28-80be-f411df7da524 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:27.580289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd2133-a33d-4a28-80be-f411df7da524 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:27.580595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd2133-a33d-4a28-80be-f411df7da524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:27.603172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5ccd2133-a33d-4a28-80be-f411df7da524 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:27.603172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ccd2133-a33d-4a28-80be-f411df7da524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:27.612562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 706/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:27.657074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a0f04-2446-4a86-9a2e-3aeafe0c2aa5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:27.673229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a0f04-2446-4a86-9a2e-3aeafe0c2aa5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:27.683702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ff79c-6cfe-4240-b4c9-d56cf38b8bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:27.684484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ff79c-6cfe-4240-b4c9-d56cf38b8bd8 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:27.685115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ff79c-6cfe-4240-b4c9-d56cf38b8bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:27.685565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ff79c-6cfe-4240-b4c9-d56cf38b8bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:27.695176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ff79c-6cfe-4240-b4c9-d56cf38b8bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:27.696882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ff79c-6cfe-4240-b4c9-d56cf38b8bd8 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:27.702218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:27.718003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 703/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:37.594024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=8 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:49.297859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe4aa1-5643-4633-a609-c0164672b0e8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:49.298576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe4aa1-5643-4633-a609-c0164672b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:49.298576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe4aa1-5643-4633-a609-c0164672b0e8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:49.299822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 707/1410] 10.222.0.27 () {54 vars in 918 bytes} [Thu Jun 23 11:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:49.305879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c5a8-092b-4a65-a206-b9c76811f419 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:49.306348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c5a8-092b-4a65-a206-b9c76811f419 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:49.306458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c5a8-092b-4a65-a206-b9c76811f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:49.326769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0090c5a8-092b-4a65-a206-b9c76811f419 None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:49.328001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0090c5a8-092b-4a65-a206-b9c76811f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:49.341658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 704/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 23 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:49.364398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6379-5091-40bf-b088-4e6d5f6ea051 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:49.364700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6379-5091-40bf-b088-4e6d5f6ea051 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:49.365004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6379-5091-40bf-b088-4e6d5f6ea051 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:49.366451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 708/1412] 10.222.0.27 () {54 vars in 918 bytes} [Thu Jun 23 11:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:49.371673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915cedf-4f30-4dc3-95ba-10363626e1ac None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:49.371963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915cedf-4f30-4dc3-95ba-10363626e1ac None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:49.372246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915cedf-4f30-4dc3-95ba-10363626e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:49.393566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4915cedf-4f30-4dc3-95ba-10363626e1ac None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:49.394811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4915cedf-4f30-4dc3-95ba-10363626e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:49.406277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 705/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Jun 23 11:49:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:51.943264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50c3a-adfd-475c-b086-b7c540deb432 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:51.943873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50c3a-adfd-475c-b086-b7c540deb432 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:51.943873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50c3a-adfd-475c-b086-b7c540deb432 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:51.945194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:51.950810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32d66-151d-475f-bfee-f06a503f0103 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:51.951276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32d66-151d-475f-bfee-f06a503f0103 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:51.951380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d32d66-151d-475f-bfee-f06a503f0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:51.970986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e0d32d66-151d-475f-bfee-f06a503f0103 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:51.972174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0d32d66-151d-475f-bfee-f06a503f0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:51.980829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:52.031435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d50c3a-adfd-475c-b086-b7c540deb432 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:52.049550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d50c3a-adfd-475c-b086-b7c540deb432 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:52.056011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fde17-c103-44a7-a749-5359e9376f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:52.056666 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fde17-c103-44a7-a749-5359e9376f21 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:52.056951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fde17-c103-44a7-a749-5359e9376f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:52.057231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fde17-c103-44a7-a749-5359e9376f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:52.066132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fde17-c103-44a7-a749-5359e9376f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:52.067784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fde17-c103-44a7-a749-5359e9376f21 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:52.077800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 710/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:53.028148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3e91-72d7-45d0-9454-5cad0a76f7da None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:53.028740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3e91-72d7-45d0-9454-5cad0a76f7da None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:53.028740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3e91-72d7-45d0-9454-5cad0a76f7da None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:53.030171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:53.036230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e661b-a345-47be-b885-0b836c049733 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:53.036942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e661b-a345-47be-b885-0b836c049733 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:53.037283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e661b-a345-47be-b885-0b836c049733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:53.062499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f33e661b-a345-47be-b885-0b836c049733 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:53.063761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f33e661b-a345-47be-b885-0b836c049733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:53.074473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:53.235769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3e91-72d7-45d0-9454-5cad0a76f7da None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:53.257238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3e91-72d7-45d0-9454-5cad0a76f7da None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:53.263198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958951d-d4ea-4cff-b701-3bb7b6126fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:53.263844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958951d-d4ea-4cff-b701-3bb7b6126fa9 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:53.264127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958951d-d4ea-4cff-b701-3bb7b6126fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:53.264402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958951d-d4ea-4cff-b701-3bb7b6126fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:53.273070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958951d-d4ea-4cff-b701-3bb7b6126fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:53.274694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958951d-d4ea-4cff-b701-3bb7b6126fa9 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:53.284507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 708/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:54.182946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69cfa2-b40c-4f00-beb4-994ef89a9aa7 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:54.183670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69cfa2-b40c-4f00-beb4-994ef89a9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:54.183670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69cfa2-b40c-4f00-beb4-994ef89a9aa7 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:54.184891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:54.190591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a046c-b361-4315-8e40-65581f1ac976 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:54.191051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a046c-b361-4315-8e40-65581f1ac976 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:54.191156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a046c-b361-4315-8e40-65581f1ac976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:54.211411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-959a046c-b361-4315-8e40-65581f1ac976 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:54.212627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-959a046c-b361-4315-8e40-65581f1ac976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:54.221584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:54.383558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69cfa2-b40c-4f00-beb4-994ef89a9aa7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:54.404195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69cfa2-b40c-4f00-beb4-994ef89a9aa7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:54.413874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2faf0f-1418-4c76-9a8e-9135ff654403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:54.414759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2faf0f-1418-4c76-9a8e-9135ff654403 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:54.415104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2faf0f-1418-4c76-9a8e-9135ff654403 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:54.415422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2faf0f-1418-4c76-9a8e-9135ff654403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:54.428367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2faf0f-1418-4c76-9a8e-9135ff654403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:54.430027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2faf0f-1418-4c76-9a8e-9135ff654403 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:54.440941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 713/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:55.321548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7be2-f98b-4f35-a556-c819e09dfdd1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:55.322181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7be2-f98b-4f35-a556-c819e09dfdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:55.322181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7be2-f98b-4f35-a556-c819e09dfdd1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:55.324102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:55.331876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139255da-bd52-4615-8fad-92f4132b462a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:55.332415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139255da-bd52-4615-8fad-92f4132b462a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:55.332568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139255da-bd52-4615-8fad-92f4132b462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:55.352814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-139255da-bd52-4615-8fad-92f4132b462a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:55.354051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-139255da-bd52-4615-8fad-92f4132b462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:55.364128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:55.516887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7be2-f98b-4f35-a556-c819e09dfdd1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:55.540338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7be2-f98b-4f35-a556-c819e09dfdd1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:55.546990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b68dc-eb71-492d-9c05-8901339f3273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:55.547628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b68dc-eb71-492d-9c05-8901339f3273 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:55.547926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b68dc-eb71-492d-9c05-8901339f3273 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:55.548206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b68dc-eb71-492d-9c05-8901339f3273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:55.557123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b68dc-eb71-492d-9c05-8901339f3273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:55.558772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b68dc-eb71-492d-9c05-8901339f3273 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:55.569796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 711/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:56.477647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edee103-2fc0-4a2b-97df-29e9696e68a6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:56.478245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edee103-2fc0-4a2b-97df-29e9696e68a6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:56.478245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edee103-2fc0-4a2b-97df-29e9696e68a6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:56.479633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:56.485005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac987-f5b8-4eaa-befa-0ee401b40b14 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:56.485452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac987-f5b8-4eaa-befa-0ee401b40b14 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:56.485566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ac987-f5b8-4eaa-befa-0ee401b40b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:56.506176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-078ac987-f5b8-4eaa-befa-0ee401b40b14 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:56.507377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-078ac987-f5b8-4eaa-befa-0ee401b40b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:56.515778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:56.669957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edee103-2fc0-4a2b-97df-29e9696e68a6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:56.698253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edee103-2fc0-4a2b-97df-29e9696e68a6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:56.704460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53c7e-d266-4330-86e8-190444bd7041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:56.705114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53c7e-d266-4330-86e8-190444bd7041 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:56.705393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53c7e-d266-4330-86e8-190444bd7041 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:56.705689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53c7e-d266-4330-86e8-190444bd7041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:56.715009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53c7e-d266-4330-86e8-190444bd7041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:56.716619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53c7e-d266-4330-86e8-190444bd7041 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:56.727032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 716/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:57.527121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ce8a9-ab5e-40a4-b25d-16fc01d5c89a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:57.527862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ce8a9-ab5e-40a4-b25d-16fc01d5c89a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:57.527862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ce8a9-ab5e-40a4-b25d-16fc01d5c89a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:57.529073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:57.538580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719ee2-7933-4f84-b67e-78606dcf41ea None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:57.539156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719ee2-7933-4f84-b67e-78606dcf41ea None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:57.539156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72719ee2-7933-4f84-b67e-78606dcf41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:57.560869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-72719ee2-7933-4f84-b67e-78606dcf41ea None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:57.562390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-72719ee2-7933-4f84-b67e-78606dcf41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:57.570992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:57.726715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ce8a9-ab5e-40a4-b25d-16fc01d5c89a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:57.745094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ce8a9-ab5e-40a4-b25d-16fc01d5c89a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:57.750812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59123e-2d51-4ad7-8708-5a3ea8966352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:57.751468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59123e-2d51-4ad7-8708-5a3ea8966352 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:57.751755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59123e-2d51-4ad7-8708-5a3ea8966352 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:57.752037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59123e-2d51-4ad7-8708-5a3ea8966352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:57.762360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59123e-2d51-4ad7-8708-5a3ea8966352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:57.763966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59123e-2d51-4ad7-8708-5a3ea8966352 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:57.774680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 714/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:58.628673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992fa5-dcea-481b-a0eb-c61c2944fdb0 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:58.629280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992fa5-dcea-481b-a0eb-c61c2944fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:58.629280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81992fa5-dcea-481b-a0eb-c61c2944fdb0 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:58.630728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:58.635984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07fc91-9f65-42a6-b046-d8bead66e486 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:58.636444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07fc91-9f65-42a6-b046-d8bead66e486 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:58.636560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07fc91-9f65-42a6-b046-d8bead66e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:58.655970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4e07fc91-9f65-42a6-b046-d8bead66e486 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:58.657201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e07fc91-9f65-42a6-b046-d8bead66e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:58.666391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:58.817425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81992fa5-dcea-481b-a0eb-c61c2944fdb0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:58.838849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81992fa5-dcea-481b-a0eb-c61c2944fdb0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:58.844783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cbe7d-106c-410e-9174-2c2cec7817be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:58.845435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cbe7d-106c-410e-9174-2c2cec7817be service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:58.845866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cbe7d-106c-410e-9174-2c2cec7817be service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:58.846145 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cbe7d-106c-410e-9174-2c2cec7817be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:58.855119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cbe7d-106c-410e-9174-2c2cec7817be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:58.856693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cbe7d-106c-410e-9174-2c2cec7817be service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:58.867535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 719/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:49:59.704989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db675d-30a4-4369-9aea-e174a434ef1d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:59.705635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db675d-30a4-4369-9aea-e174a434ef1d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:59.705635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db675d-30a4-4369-9aea-e174a434ef1d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:59.706999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:49:59.714297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3df3-135b-45a7-bbda-32cd1cb41fc8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:59.715061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3df3-135b-45a7-bbda-32cd1cb41fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:59.715247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3df3-135b-45a7-bbda-32cd1cb41fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:59.743279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-768c3df3-135b-45a7-bbda-32cd1cb41fc8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:49:59.744482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-768c3df3-135b-45a7-bbda-32cd1cb41fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:49:59.754137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:49:59.910776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db675d-30a4-4369-9aea-e174a434ef1d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:49:59.932525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db675d-30a4-4369-9aea-e174a434ef1d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:49:59.938975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c98018-584a-461d-80bd-4f3d5983593a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:49:59.939620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c98018-584a-461d-80bd-4f3d5983593a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:49:59.939912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c98018-584a-461d-80bd-4f3d5983593a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:49:59.940197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c98018-584a-461d-80bd-4f3d5983593a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:49:59.948826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c98018-584a-461d-80bd-4f3d5983593a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:49:59.950469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c98018-584a-461d-80bd-4f3d5983593a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:49:59.960227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 717/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:00.766548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c9f7-ea79-480b-a049-dd9b970efbae None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:00.767154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c9f7-ea79-480b-a049-dd9b970efbae None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:00.767154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c9f7-ea79-480b-a049-dd9b970efbae None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:00.768530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:00.773808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931394e-f3aa-4828-b656-ebd3657b4163 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:00.774239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931394e-f3aa-4828-b656-ebd3657b4163 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:00.774360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931394e-f3aa-4828-b656-ebd3657b4163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:00.793656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8931394e-f3aa-4828-b656-ebd3657b4163 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:00.794886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8931394e-f3aa-4828-b656-ebd3657b4163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:00.805375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:00.991410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c9f7-ea79-480b-a049-dd9b970efbae None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:01.012616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c9f7-ea79-480b-a049-dd9b970efbae None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:01.018771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3e3b-430f-4b50-839e-0bab9781bbd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:01.019424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3e3b-430f-4b50-839e-0bab9781bbd7 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:01.019757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3e3b-430f-4b50-839e-0bab9781bbd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:01.020043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3e3b-430f-4b50-839e-0bab9781bbd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:01.028866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3e3b-430f-4b50-839e-0bab9781bbd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:01.030493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3e3b-430f-4b50-839e-0bab9781bbd7 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:01.040404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 722/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:02.994161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3cbae-2d53-4b2c-a1ae-3b232357864c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:02.994744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3cbae-2d53-4b2c-a1ae-3b232357864c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:02.994744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3cbae-2d53-4b2c-a1ae-3b232357864c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:02.996614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:03.002027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafcae-ca71-4a3d-812f-cd5d9caf67bc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:03.002466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafcae-ca71-4a3d-812f-cd5d9caf67bc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:03.002610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cafcae-ca71-4a3d-812f-cd5d9caf67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:03.022655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-26cafcae-ca71-4a3d-812f-cd5d9caf67bc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:03.023874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-26cafcae-ca71-4a3d-812f-cd5d9caf67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:03.033268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:03.072473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3cbae-2d53-4b2c-a1ae-3b232357864c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:03.090609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3cbae-2d53-4b2c-a1ae-3b232357864c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:03.096368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcf8e-f3bb-46d6-b7b4-2755838a7a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:03.097099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcf8e-f3bb-46d6-b7b4-2755838a7a98 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:03.097506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcf8e-f3bb-46d6-b7b4-2755838a7a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:03.097929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcf8e-f3bb-46d6-b7b4-2755838a7a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:03.108257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcf8e-f3bb-46d6-b7b4-2755838a7a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:03.109736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcf8e-f3bb-46d6-b7b4-2755838a7a98 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:03.120210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 720/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:05.404647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951fa3-6427-4423-a34d-0bebbb1f38fa None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:05.405251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951fa3-6427-4423-a34d-0bebbb1f38fa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:05.405251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951fa3-6427-4423-a34d-0bebbb1f38fa None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:05.407380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:05.413009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb07e9-5e47-46ce-aa39-d2fab642b435 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:05.413451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb07e9-5e47-46ce-aa39-d2fab642b435 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:05.413570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb07e9-5e47-46ce-aa39-d2fab642b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:05.433061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-26cb07e9-5e47-46ce-aa39-d2fab642b435 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:05.434308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-26cb07e9-5e47-46ce-aa39-d2fab642b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:05.442934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:05.485147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951fa3-6427-4423-a34d-0bebbb1f38fa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:05.504607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951fa3-6427-4423-a34d-0bebbb1f38fa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:05.508877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6159a-bd38-4ed4-b00d-f2a6943673b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:05.509529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6159a-bd38-4ed4-b00d-f2a6943673b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:05.509841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6159a-bd38-4ed4-b00d-f2a6943673b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:05.510114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6159a-bd38-4ed4-b00d-f2a6943673b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:05.519574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6159a-bd38-4ed4-b00d-f2a6943673b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:05.521186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6159a-bd38-4ed4-b00d-f2a6943673b4 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:05.530974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 725/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:08.004876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178fc8-8f05-4cac-8aed-99aa9b4cb063 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:08.005451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178fc8-8f05-4cac-8aed-99aa9b4cb063 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:08.005451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178fc8-8f05-4cac-8aed-99aa9b4cb063 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:08.006826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:08.012837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3ea6-6acf-4e5c-a309-e9efc60771ad None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:08.013349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3ea6-6acf-4e5c-a309-e9efc60771ad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:08.013349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3ea6-6acf-4e5c-a309-e9efc60771ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:08.032941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-407c3ea6-6acf-4e5c-a309-e9efc60771ad None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:08.034231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-407c3ea6-6acf-4e5c-a309-e9efc60771ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:08.043816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:08.083451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178fc8-8f05-4cac-8aed-99aa9b4cb063 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:08.100928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178fc8-8f05-4cac-8aed-99aa9b4cb063 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:08.106894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78d268-13f4-4007-af49-3aeba11a0207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:08.107819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78d268-13f4-4007-af49-3aeba11a0207 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:08.108208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78d268-13f4-4007-af49-3aeba11a0207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:08.108581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78d268-13f4-4007-af49-3aeba11a0207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:08.120194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78d268-13f4-4007-af49-3aeba11a0207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:08.121639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78d268-13f4-4007-af49-3aeba11a0207 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:08.131249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 723/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:10.294918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacb43b-7941-40eb-9c54-ef3d65926939 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:10.295767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacb43b-7941-40eb-9c54-ef3d65926939 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:10.295767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacb43b-7941-40eb-9c54-ef3d65926939 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:10.297841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:10.303553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df162-b5a8-4f3e-89ed-f3a1db9dcf71 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:10.304079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df162-b5a8-4f3e-89ed-f3a1db9dcf71 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:10.304079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6df162-b5a8-4f3e-89ed-f3a1db9dcf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:10.323946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2a6df162-b5a8-4f3e-89ed-f3a1db9dcf71 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:10.325153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2a6df162-b5a8-4f3e-89ed-f3a1db9dcf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:10.334389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:10.376441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacb43b-7941-40eb-9c54-ef3d65926939 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:10.395426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacb43b-7941-40eb-9c54-ef3d65926939 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:10.399626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96917e-ad8d-4de1-b755-97c9984784a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:10.400279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96917e-ad8d-4de1-b755-97c9984784a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:10.400566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96917e-ad8d-4de1-b755-97c9984784a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:10.400846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96917e-ad8d-4de1-b755-97c9984784a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:10.410063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96917e-ad8d-4de1-b755-97c9984784a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:10.411861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96917e-ad8d-4de1-b755-97c9984784a8 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:10.421633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 728/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:12.596030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2709-cf80-4e45-a23d-c72900a43939 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:12.596604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2709-cf80-4e45-a23d-c72900a43939 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:12.596604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2709-cf80-4e45-a23d-c72900a43939 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:12.598636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:12.604244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d06-707b-4828-9639-9cefc7f09b65 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:12.605799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d06-707b-4828-9639-9cefc7f09b65 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:12.605799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d06-707b-4828-9639-9cefc7f09b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:12.626866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fe6f1d06-707b-4828-9639-9cefc7f09b65 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:12.628084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fe6f1d06-707b-4828-9639-9cefc7f09b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:12.637207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:12.687970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2709-cf80-4e45-a23d-c72900a43939 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:12.700275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2709-cf80-4e45-a23d-c72900a43939 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:12.704891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5d1a-cf76-49fe-b658-eff8ed8e7151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:12.705590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5d1a-cf76-49fe-b658-eff8ed8e7151 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:12.705911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5d1a-cf76-49fe-b658-eff8ed8e7151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:12.706191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5d1a-cf76-49fe-b658-eff8ed8e7151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:12.716037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5d1a-cf76-49fe-b658-eff8ed8e7151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:12.717478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5d1a-cf76-49fe-b658-eff8ed8e7151 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:12.727849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 726/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:50:14.829953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc6fb-28cd-4711-b297-d7251a8c2c9d None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:14.830844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc6fb-28cd-4711-b297-d7251a8c2c9d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:14.830844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc6fb-28cd-4711-b297-d7251a8c2c9d None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:14.832965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:14.839238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2abdde-f0d8-440c-a403-77b316f35c62 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:14.839679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2abdde-f0d8-440c-a403-77b316f35c62 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:14.839840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2abdde-f0d8-440c-a403-77b316f35c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:14.864916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5c2abdde-f0d8-440c-a403-77b316f35c62 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:14.866134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c2abdde-f0d8-440c-a403-77b316f35c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:14.881407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:14.924910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dc6fb-28cd-4711-b297-d7251a8c2c9d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:14.937434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dc6fb-28cd-4711-b297-d7251a8c2c9d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:14.942794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed3f02-b385-4b86-91c2-d33c043e6b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:14.943449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3f02-b385-4b86-91c2-d33c043e6b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:14.943732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3f02-b385-4b86-91c2-d33c043e6b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:14.943981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3f02-b385-4b86-91c2-d33c043e6b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:14.955784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed3f02-b385-4b86-91c2-d33c043e6b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:14.957308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed3f02-b385-4b86-91c2-d33c043e6b6e service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:14.967538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 731/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:17.133915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3303c1-b7a8-45e4-9b61-798e3fbedbdb None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:17.134526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3303c1-b7a8-45e4-9b61-798e3fbedbdb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:17.134526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3303c1-b7a8-45e4-9b61-798e3fbedbdb None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:17.135902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:17.142582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe18ed7-afc2-4fbf-8f79-37ae3256ccdd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:17.143458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe18ed7-afc2-4fbf-8f79-37ae3256ccdd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:17.143458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe18ed7-afc2-4fbf-8f79-37ae3256ccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:17.171219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bfe18ed7-afc2-4fbf-8f79-37ae3256ccdd None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:17.173095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bfe18ed7-afc2-4fbf-8f79-37ae3256ccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:17.182734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:17.223397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3303c1-b7a8-45e4-9b61-798e3fbedbdb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:17.237880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3303c1-b7a8-45e4-9b61-798e3fbedbdb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:17.242404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99514d82-3ed1-4ad5-80ad-5bea42234960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:17.243060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99514d82-3ed1-4ad5-80ad-5bea42234960 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:17.243347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99514d82-3ed1-4ad5-80ad-5bea42234960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:17.243638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99514d82-3ed1-4ad5-80ad-5bea42234960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:17.254554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99514d82-3ed1-4ad5-80ad-5bea42234960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:17.256035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99514d82-3ed1-4ad5-80ad-5bea42234960 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:17.266377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 729/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:19.374826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4109388-5dec-48df-8f0a-59bf9f5e6159 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:19.375406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4109388-5dec-48df-8f0a-59bf9f5e6159 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:19.375406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4109388-5dec-48df-8f0a-59bf9f5e6159 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:19.376834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:19.383375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c523b-7e3d-4329-a9c2-30fe7d346486 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:19.384102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c523b-7e3d-4329-a9c2-30fe7d346486 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:19.384212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c523b-7e3d-4329-a9c2-30fe7d346486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:19.392068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=79 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:19.406212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f07c523b-7e3d-4329-a9c2-30fe7d346486 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:19.407442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f07c523b-7e3d-4329-a9c2-30fe7d346486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:19.416483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:19.456946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4109388-5dec-48df-8f0a-59bf9f5e6159 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:19.463506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=73 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:19.470508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4109388-5dec-48df-8f0a-59bf9f5e6159 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:19.474563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6a142-c51d-414e-b455-69eedbd06547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:19.475213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6a142-c51d-414e-b455-69eedbd06547 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:19.475499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6a142-c51d-414e-b455-69eedbd06547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:19.475884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6a142-c51d-414e-b455-69eedbd06547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:19.491203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6a142-c51d-414e-b455-69eedbd06547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:19.493395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6a142-c51d-414e-b455-69eedbd06547 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:19.507522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 734/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:21.608954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f581f2-47e3-4259-aaac-448924a03cc1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:21.609381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f581f2-47e3-4259-aaac-448924a03cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:21.609541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f581f2-47e3-4259-aaac-448924a03cc1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:21.610987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:21.618048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79ec0-2ff8-4494-b5a1-268cec1233f5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:21.618537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79ec0-2ff8-4494-b5a1-268cec1233f5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:21.618643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79ec0-2ff8-4494-b5a1-268cec1233f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:21.639782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-23c79ec0-2ff8-4494-b5a1-268cec1233f5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:21.641481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-23c79ec0-2ff8-4494-b5a1-268cec1233f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:21.651472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:21.693293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f581f2-47e3-4259-aaac-448924a03cc1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:21.710462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f581f2-47e3-4259-aaac-448924a03cc1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:21.714294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b958f9-e04f-4f81-b1ac-46205fb22d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:21.714951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b958f9-e04f-4f81-b1ac-46205fb22d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:21.715221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b958f9-e04f-4f81-b1ac-46205fb22d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:21.715496 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b958f9-e04f-4f81-b1ac-46205fb22d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:21.725981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b958f9-e04f-4f81-b1ac-46205fb22d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:21.727434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b958f9-e04f-4f81-b1ac-46205fb22d7f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:21.738489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 732/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:23.830798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bb983-a50d-4022-b64d-4588fa4fe647 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:23.831965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bb983-a50d-4022-b64d-4588fa4fe647 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:23.832276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bb983-a50d-4022-b64d-4588fa4fe647 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:23.834466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:50:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:23.842995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429705-01fb-4a8a-bcc5-4f35ac63aa63 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:23.843649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429705-01fb-4a8a-bcc5-4f35ac63aa63 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:23.843813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5429705-01fb-4a8a-bcc5-4f35ac63aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:23.871340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d5429705-01fb-4a8a-bcc5-4f35ac63aa63 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:23.872518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d5429705-01fb-4a8a-bcc5-4f35ac63aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:23.883080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:23.923146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bb983-a50d-4022-b64d-4588fa4fe647 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:23.934813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bb983-a50d-4022-b64d-4588fa4fe647 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:23.938806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32da4-bd34-4eb2-9def-d1d5fb9c86e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:23.939442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32da4-bd34-4eb2-9def-d1d5fb9c86e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:23.939722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32da4-bd34-4eb2-9def-d1d5fb9c86e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:23.939997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32da4-bd34-4eb2-9def-d1d5fb9c86e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:23.949869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32da4-bd34-4eb2-9def-d1d5fb9c86e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:23.951311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32da4-bd34-4eb2-9def-d1d5fb9c86e8 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:23.961889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 737/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:50:33.870116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=11 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:33.956710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=14 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:44.215110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3d07-4c3d-4626-8282-d439e553388d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:44.215729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3d07-4c3d-4626-8282-d439e553388d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:44.215729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3d07-4c3d-4626-8282-d439e553388d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:44.217068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 734/1471] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:44.222954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792577b-769f-4e81-9d77-6b6592d79062 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:44.223428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792577b-769f-4e81-9d77-6b6592d79062 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:44.223533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792577b-769f-4e81-9d77-6b6592d79062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:44.249286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d792577b-769f-4e81-9d77-6b6592d79062 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:44.251157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d792577b-769f-4e81-9d77-6b6592d79062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:44.261392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 738/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:44.313365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251e523-e438-43e0-b437-b79b2c4ac040 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:44.313667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251e523-e438-43e0-b437-b79b2c4ac040 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:44.313943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251e523-e438-43e0-b437-b79b2c4ac040 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:44.315594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 735/1473] 10.222.0.27 () {54 vars in 962 bytes} [Thu Jun 23 11:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:44.321728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156922-c901-4652-82f8-ce76b3ee29fe None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:44.322031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156922-c901-4652-82f8-ce76b3ee29fe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:44.322294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af156922-c901-4652-82f8-ce76b3ee29fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:44.341781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-af156922-c901-4652-82f8-ce76b3ee29fe None None] MFA Rules not processed for user `211375edc5774281947e0b47714a1a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:44.342997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-af156922-c901-4652-82f8-ce76b3ee29fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:44.350956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 739/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Jun 23 11:50:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:44.362129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251e523-e438-43e0-b437-b79b2c4ac040 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:44.374668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251e523-e438-43e0-b437-b79b2c4ac040 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:44.379120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f71b5f-db3c-4e05-a820-b30c5083b57a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:44.379757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71b5f-db3c-4e05-a820-b30c5083b57a service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:44.380042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71b5f-db3c-4e05-a820-b30c5083b57a service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:44.380313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71b5f-db3c-4e05-a820-b30c5083b57a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:44.390240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f71b5f-db3c-4e05-a820-b30c5083b57a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:44.391687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f71b5f-db3c-4e05-a820-b30c5083b57a service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:44.402379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 736/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:46.523936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9addb-bc01-47db-ad5d-ebcc38e36216 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:46.524803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9addb-bc01-47db-ad5d-ebcc38e36216 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:46.524803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9addb-bc01-47db-ad5d-ebcc38e36216 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:46.527148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 740/1476] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:46.535304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7559d-74cd-48c5-a08e-75d4c38a4fd6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:46.535799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7559d-74cd-48c5-a08e-75d4c38a4fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:46.535903 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7559d-74cd-48c5-a08e-75d4c38a4fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:46.555476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c0d7559d-74cd-48c5-a08e-75d4c38a4fd6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:46.556705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c0d7559d-74cd-48c5-a08e-75d4c38a4fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:46.566732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 737/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:46.590313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9addb-bc01-47db-ad5d-ebcc38e36216 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:46.606198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9addb-bc01-47db-ad5d-ebcc38e36216 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:46.611212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:46.611894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:46.612522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:46.612841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:46.613871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:46.615763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:50:46.615763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:50:46.615763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:50:46.616930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118f0c-1b84-40b3-8292-ddfd993fe589 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:46.637428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 741/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Jun 23 11:50:46 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:50:48.704753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea2c63-9639-40be-9624-fb10db71ae13 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:48.705778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea2c63-9639-40be-9624-fb10db71ae13 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:48.705778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea2c63-9639-40be-9624-fb10db71ae13 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:48.708004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 738/1479] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:48.713629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5b7f-eee9-4b64-aab6-c32b2f1aba9e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:48.714098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5b7f-eee9-4b64-aab6-c32b2f1aba9e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:48.714211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda5b7f-eee9-4b64-aab6-c32b2f1aba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:48.734517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fcda5b7f-eee9-4b64-aab6-c32b2f1aba9e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:48.735752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fcda5b7f-eee9-4b64-aab6-c32b2f1aba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:48.745463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 742/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:48.795317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea2c63-9639-40be-9624-fb10db71ae13 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:48.811727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea2c63-9639-40be-9624-fb10db71ae13 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:48.818201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22df61-088a-4296-919d-10bb8ba4d574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:48.818853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22df61-088a-4296-919d-10bb8ba4d574 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:48.819140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22df61-088a-4296-919d-10bb8ba4d574 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:48.819421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22df61-088a-4296-919d-10bb8ba4d574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:48.828418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22df61-088a-4296-919d-10bb8ba4d574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:48.830067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22df61-088a-4296-919d-10bb8ba4d574 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:48.841070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 739/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:51.056446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee14ca-0fbf-4857-b51e-2d4169b1ddf2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:51.057398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee14ca-0fbf-4857-b51e-2d4169b1ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:51.057398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee14ca-0fbf-4857-b51e-2d4169b1ddf2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:51.059600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 743/1482] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:51.065874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ffdc-a497-4cc9-b894-c28c9b8a1027 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:51.066337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ffdc-a497-4cc9-b894-c28c9b8a1027 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:51.066440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4ffdc-a497-4cc9-b894-c28c9b8a1027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:51.084882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e9e4ffdc-a497-4cc9-b894-c28c9b8a1027 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:51.086154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e9e4ffdc-a497-4cc9-b894-c28c9b8a1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:51.095632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 740/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:51.145925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee14ca-0fbf-4857-b51e-2d4169b1ddf2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:51.160999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee14ca-0fbf-4857-b51e-2d4169b1ddf2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:51.167718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27621292-54ad-467f-85e9-e3c3621281cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:51.168372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27621292-54ad-467f-85e9-e3c3621281cd service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:51.168660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27621292-54ad-467f-85e9-e3c3621281cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:51.168934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27621292-54ad-467f-85e9-e3c3621281cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:51.184580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27621292-54ad-467f-85e9-e3c3621281cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:51.186854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27621292-54ad-467f-85e9-e3c3621281cd service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:51.199063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 744/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:53.341240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37804e83-be16-4c15-b398-75c79d59deb4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:53.342012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37804e83-be16-4c15-b398-75c79d59deb4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:53.342012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37804e83-be16-4c15-b398-75c79d59deb4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:53.343909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 741/1485] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:53.351910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5e43-fbed-4866-959a-f092adcbe404 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:53.352418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5e43-fbed-4866-959a-f092adcbe404 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:53.352514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e5e43-fbed-4866-959a-f092adcbe404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:53.380655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9b3e5e43-fbed-4866-959a-f092adcbe404 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:53.381916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9b3e5e43-fbed-4866-959a-f092adcbe404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:53.391437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 745/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:53.436107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37804e83-be16-4c15-b398-75c79d59deb4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:53.452863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37804e83-be16-4c15-b398-75c79d59deb4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:53.464514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79fd73-4a34-457f-808d-cecc6b4ae78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:53.465223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd73-4a34-457f-808d-cecc6b4ae78d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:53.465505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd73-4a34-457f-808d-cecc6b4ae78d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:53.465824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd73-4a34-457f-808d-cecc6b4ae78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:53.477799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79fd73-4a34-457f-808d-cecc6b4ae78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:53.479254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79fd73-4a34-457f-808d-cecc6b4ae78d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:53.489642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 742/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:55.652729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5871-2e19-4431-9ba4-573411bd7aa8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:55.653286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5871-2e19-4431-9ba4-573411bd7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:55.653286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5871-2e19-4431-9ba4-573411bd7aa8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:55.654731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 746/1488] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:55.661539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c066af-ba13-4193-85b7-3c19cc58eee4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:55.662294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c066af-ba13-4193-85b7-3c19cc58eee4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:55.662404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c066af-ba13-4193-85b7-3c19cc58eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:55.690291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-22c066af-ba13-4193-85b7-3c19cc58eee4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:55.692297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-22c066af-ba13-4193-85b7-3c19cc58eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:55.701533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 743/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:55.744405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5871-2e19-4431-9ba4-573411bd7aa8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:55.757188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5871-2e19-4431-9ba4-573411bd7aa8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:55.761070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf1c6d-5339-4bd0-88c2-7579a537e1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:55.761753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf1c6d-5339-4bd0-88c2-7579a537e1fa service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:55.762048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf1c6d-5339-4bd0-88c2-7579a537e1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:55.762327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf1c6d-5339-4bd0-88c2-7579a537e1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:55.772096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf1c6d-5339-4bd0-88c2-7579a537e1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:55.773546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf1c6d-5339-4bd0-88c2-7579a537e1fa service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:55.783284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 747/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:50:58.090015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329bc4c-8a15-4e47-9bab-71d7044d38a3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:58.090626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329bc4c-8a15-4e47-9bab-71d7044d38a3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:58.090626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329bc4c-8a15-4e47-9bab-71d7044d38a3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:58.092000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 744/1491] 10.222.0.27 () {54 vars in 926 bytes} [Thu Jun 23 11:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:50:58.098734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ffb0d-0192-408d-ab0b-f0200d5d386b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:58.099476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ffb0d-0192-408d-ab0b-f0200d5d386b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:58.099650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ffb0d-0192-408d-ab0b-f0200d5d386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:58.128555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-642ffb0d-0192-408d-ab0b-f0200d5d386b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:50:58.130605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-642ffb0d-0192-408d-ab0b-f0200d5d386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:50:58.144076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 748/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Thu Jun 23 11:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:50:58.187886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329bc4c-8a15-4e47-9bab-71d7044d38a3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:50:58.207667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329bc4c-8a15-4e47-9bab-71d7044d38a3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:50:58.212310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea0f1f-d994-420d-9e8c-c50ac24000d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:50:58.212957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0f1f-d994-420d-9e8c-c50ac24000d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:50:58.213234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0f1f-d994-420d-9e8c-c50ac24000d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:50:58.213507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0f1f-d994-420d-9e8c-c50ac24000d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:50:58.224359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea0f1f-d994-420d-9e8c-c50ac24000d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:50:58.225813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea0f1f-d994-420d-9e8c-c50ac24000d2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:50:58.236244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 745/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:51:08.119833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=33 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:08.231540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=33 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:24.704653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:24.705276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:24.705276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:24.730276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:52:24.731465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:24.741432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 749/1494] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:52:24.751011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:24.751533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:24.751640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:24.771074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:52:24.772264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:24.781275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 746/1495] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:52:24.786849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:24.797404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be4a89-07d7-4633-96d9-20e5eb527205 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:24.804574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:24.805244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:24.805527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:24.805833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:24.806572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:52:24.806892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:24.807917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:24.807917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:52:24.807917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:52:24.808831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:24.821802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 750/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:52:24.830818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:24.840998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff237762-a191-4442-9bb4-5c1615180385 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:24.846456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:24.847119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:24.847405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:24.847682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:24.848672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:24.850906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:24.850906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:52:24.850906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:52:24.852136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:24.900483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 747/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:52:24 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:52:24.904963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:24.915674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447d9a-074c-4f40-8b49-01bcb4331375 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:24.980401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:24.981078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:24.981364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:24.981638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:24.982371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:24.983400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:24.983400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:52:24.983400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:52:24.984602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.006256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 751/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:52:24 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:52:25.010538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:25.021723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631a1f5-b737-48c8-9b48-b4273c6fb273 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:25.026840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:25.027523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.027805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.028085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.028828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:25.029886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:25.029886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:52:25.029886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:52:25.030779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.044033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 748/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:52:25.048597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:25.063839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b46d6-f625-4638-a3cc-66937de2bf48 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:25.069308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:25.070006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.070285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.070563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.071307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:25.072333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:25.072333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:52:25.072333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:52:25.073219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd62b2-0888-47ce-b7ac-cb855c72220c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.087533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 752/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:52:25.092614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:25.109336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d01ebc-c957-4a01-a7ea-e4ea66f24054 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:25.117460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:25.118387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.118676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.118956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] PATH_INFO: `/v3/projects/2b62d2d2384c491e87ad2a5c9551c703/users/44fe4a4b1edb410a990d794b9aff4ec0/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.135725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b62d2d2384c491e87ad2a5c9551c703, user_id=44fe4a4b1edb410a990d794b9aff4ec0, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:25.136783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:25.136783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:52:25.136783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:52:25.138776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45590c4d-f846-418f-a91e-4c367aab1e3e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.154808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 749/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:52:25 2022] PUT /identity/v3/projects/2b62d2d2384c491e87ad2a5c9551c703/users/44fe4a4b1edb410a990d794b9aff4ec0/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:52:25.165895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15fbd2-d2fe-4ea6-bc2f-8b332e3d4e02 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.166189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15fbd2-d2fe-4ea6-bc2f-8b332e3d4e02 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.166472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15fbd2-d2fe-4ea6-bc2f-8b332e3d4e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.193562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cb15fbd2-d2fe-4ea6-bc2f-8b332e3d4e02 None None] MFA Rules not processed for user `44fe4a4b1edb410a990d794b9aff4ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:52:25.194815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cb15fbd2-d2fe-4ea6-bc2f-8b332e3d4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:25.274210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 753/1502] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:52:25.290592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108832f-3aa5-4164-a74c-c4773d7c1ded None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.290882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108832f-3aa5-4164-a74c-c4773d7c1ded None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.291166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108832f-3aa5-4164-a74c-c4773d7c1ded None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.292553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 750/1503] 10.222.0.27 () {54 vars in 963 bytes} [Thu Jun 23 11:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:52:25.297479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c779-62dc-43da-a619-2bd5c861308b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.297803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c779-62dc-43da-a619-2bd5c861308b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.298152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5c779-62dc-43da-a619-2bd5c861308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.318207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c5c5c779-62dc-43da-a619-2bd5c861308b None None] MFA Rules not processed for user `57ae4c65d3be47eeb52566dec6cb286c`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:52:25.319688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c5c5c779-62dc-43da-a619-2bd5c861308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:25.376774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:25.387032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 754/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Thu Jun 23 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:52:25.395437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108832f-3aa5-4164-a74c-c4773d7c1ded None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:25.412264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108832f-3aa5-4164-a74c-c4773d7c1ded None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:25.416630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:25.417275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.417559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.417870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.427864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:25.429317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.438557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 751/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:52:25.480873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a520-2853-4120-a2b9-caf0d9921b02 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.481148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a520-2853-4120-a2b9-caf0d9921b02 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.481424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a520-2853-4120-a2b9-caf0d9921b02 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.482784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 755/1506] 10.222.0.27 () {52 vars in 829 bytes} [Thu Jun 23 11:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:52:25.487125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:25.555489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc818c3c-5124-4f4c-944b-a0a5970c96b1 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:25.560171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:25.561063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.561350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.561645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] PATH_INFO: `/v3/users/44fe4a4b1edb410a990d794b9aff4ec0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.562890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fe4a4b1edb410a990d794b9aff4ec0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:25.563916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:25.563916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:52:25.563916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:52:25.565148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.638888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fe4a4b1edb410a990d794b9aff4ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:25.651833 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fe4a4b1edb410a990d794b9aff4ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:25.652628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fe4a4b1edb410a990d794b9aff4ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:25.664780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fe4a4b1edb410a990d794b9aff4ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:25.665624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fe4a4b1edb410a990d794b9aff4ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:25.687252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:25.699441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 752/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:52:25 2022] DELETE /identity/v3/users/44fe4a4b1edb410a990d794b9aff4ec0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:52:25.704706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.705198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.705330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.724847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:52:25.726098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:25.785786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 756/1508] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:52:25.796266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:25.798450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:25.865787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6c95-77d3-476f-b81c-3c00f96d56cb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:25.870184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f976c-2889-44e5-9488-bedb7fbcbc74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:25.870863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f976c-2889-44e5-9488-bedb7fbcbc74 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:25.871149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f976c-2889-44e5-9488-bedb7fbcbc74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:25.871428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f976c-2889-44e5-9488-bedb7fbcbc74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:25.882765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f976c-2889-44e5-9488-bedb7fbcbc74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:25.884237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f976c-2889-44e5-9488-bedb7fbcbc74 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:25.894602 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 753/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:52:26.242957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:52:26.244535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:52:26.257186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa96fb-fa88-4e8c-b200-e09c8b946144 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:52:26.262660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:52:26.263742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:52:26.264030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:52:26.264308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] PATH_INFO: `/v3/projects/2b62d2d2384c491e87ad2a5c9551c703` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:52:26.265627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b62d2d2384c491e87ad2a5c9551c703)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:52:26.267256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:26.267256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:52:26.267256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:52:26.268644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:52:26.334828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b62d2d2384c491e87ad2a5c9551c703', 'request_id': 'req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:26.345338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b62d2d2384c491e87ad2a5c9551c703', 'request_id': 'req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:26.362312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b62d2d2384c491e87ad2a5c9551c703', 'request_id': 'req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:26.375857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] The token cache is being invalidate because project 2b62d2d2384c491e87ad2a5c9551c703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:52:26.376259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:26.377068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ffabbc4a-5c22-444e-8bf8-5dcaea70fb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:52:26.378916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 757/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:52:26 2022] DELETE /identity/v3/projects/2b62d2d2384c491e87ad2a5c9551c703 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:52:35.890101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:36.372484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:13.972177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa15f00-02e2-4f54-a9a7-375f68efcb37 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:13.972770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa15f00-02e2-4f54-a9a7-375f68efcb37 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:13.972770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa15f00-02e2-4f54-a9a7-375f68efcb37 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:13.974122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:13.980060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6e41-9cff-49d6-a92c-903b87be9e6f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:13.980769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6e41-9cff-49d6-a92c-903b87be9e6f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:13.980873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6e41-9cff-49d6-a92c-903b87be9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:14.007950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3e9d6e41-9cff-49d6-a92c-903b87be9e6f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:14.009197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3e9d6e41-9cff-49d6-a92c-903b87be9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:14.071908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:14.230910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa15f00-02e2-4f54-a9a7-375f68efcb37 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:14.233916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1fa15f00-02e2-4f54-a9a7-375f68efcb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:14.320757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa15f00-02e2-4f54-a9a7-375f68efcb37 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:14.327026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bf7f1-1227-4da8-af82-458303b447dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:14.327848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf7f1-1227-4da8-af82-458303b447dc service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:14.328097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf7f1-1227-4da8-af82-458303b447dc service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:14.328378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf7f1-1227-4da8-af82-458303b447dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:14.338008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bf7f1-1227-4da8-af82-458303b447dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:14.339640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bf7f1-1227-4da8-af82-458303b447dc service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:14.349567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 755/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:15.207755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc1905-94de-48d2-ab6a-e344c30b04df None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:15.208773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc1905-94de-48d2-ab6a-e344c30b04df None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:15.208773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc1905-94de-48d2-ab6a-e344c30b04df None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:15.211127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:54:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:15.219847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8ad7-ea9c-4455-a8e2-198842d54780 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:15.220646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8ad7-ea9c-4455-a8e2-198842d54780 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:15.220834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8ad7-ea9c-4455-a8e2-198842d54780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:15.241006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-872b8ad7-ea9c-4455-a8e2-198842d54780 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:15.242265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-872b8ad7-ea9c-4455-a8e2-198842d54780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:15.250843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:15.408749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc1905-94de-48d2-ab6a-e344c30b04df None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:15.426115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc1905-94de-48d2-ab6a-e344c30b04df None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:15.432060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab1925-bb1f-46be-a295-ffb3984922da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:15.432720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1925-bb1f-46be-a295-ffb3984922da service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:15.433005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1925-bb1f-46be-a295-ffb3984922da service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:15.433365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab1925-bb1f-46be-a295-ffb3984922da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:15.442927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1925-bb1f-46be-a295-ffb3984922da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:15.444654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab1925-bb1f-46be-a295-ffb3984922da service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:15.455992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 760/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:15.771665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b411b83-9d6c-40b1-b420-6e0401a2be20 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:15.771941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b411b83-9d6c-40b1-b420-6e0401a2be20 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:15.772224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b411b83-9d6c-40b1-b420-6e0401a2be20 None None] PATH_INFO: `/v3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:15.773586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 757/1517] 10.222.0.64 () {54 vars in 925 bytes} [Thu Jun 23 11:54:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:54:15.780946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948739-43c4-4684-9628-247ca536f5b0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:15.781271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948739-43c4-4684-9628-247ca536f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:15.781617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04948739-43c4-4684-9628-247ca536f5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:15.806560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-04948739-43c4-4684-9628-247ca536f5b0 None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:15.807778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-04948739-43c4-4684-9628-247ca536f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:15.882787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 761/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jun 23 11:54:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:19.744210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345e9cc-58c3-418a-930d-775a7193b318 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:19.744954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345e9cc-58c3-418a-930d-775a7193b318 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:19.744954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345e9cc-58c3-418a-930d-775a7193b318 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:19.747034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 758/1519] 10.222.0.27 () {54 vars in 960 bytes} [Thu Jun 23 11:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:19.754497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd1944-157d-4e19-b49a-b72802875d9a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:19.755535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd1944-157d-4e19-b49a-b72802875d9a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:19.755535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd1944-157d-4e19-b49a-b72802875d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:19.777650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4dfd1944-157d-4e19-b49a-b72802875d9a None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:19.778867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4dfd1944-157d-4e19-b49a-b72802875d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:19.788848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 762/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Thu Jun 23 11:54:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:19.796894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345e9cc-58c3-418a-930d-775a7193b318 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:19.811859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345e9cc-58c3-418a-930d-775a7193b318 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:19.817430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce66957-559a-4a17-a7dc-0aacbb963c0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:19.818108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66957-559a-4a17-a7dc-0aacbb963c0a service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:19.818397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66957-559a-4a17-a7dc-0aacbb963c0a service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:19.818675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce66957-559a-4a17-a7dc-0aacbb963c0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:19.827863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce66957-559a-4a17-a7dc-0aacbb963c0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:19.829465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce66957-559a-4a17-a7dc-0aacbb963c0a service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:19.839367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 759/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:26.729312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6dddc-beec-4987-853d-b386cd7a2b30 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:26.729993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6dddc-beec-4987-853d-b386cd7a2b30 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:26.729993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6dddc-beec-4987-853d-b386cd7a2b30 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:26.732060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:54:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:26.739918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbec4-df4d-4c72-940f-00854333c915 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:26.740374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbec4-df4d-4c72-940f-00854333c915 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:26.740497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbec4-df4d-4c72-940f-00854333c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:26.761140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5cbcbec4-df4d-4c72-940f-00854333c915 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:26.762380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5cbcbec4-df4d-4c72-940f-00854333c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:26.771215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:54:26.930330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6dddc-beec-4987-853d-b386cd7a2b30 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:26.946758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6dddc-beec-4987-853d-b386cd7a2b30 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:26.952402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26363bea-2038-4b3e-aaba-382c1b2c4c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:26.953041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363bea-2038-4b3e-aaba-382c1b2c4c23 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:26.953328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363bea-2038-4b3e-aaba-382c1b2c4c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:26.953629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363bea-2038-4b3e-aaba-382c1b2c4c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:26.962194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26363bea-2038-4b3e-aaba-382c1b2c4c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:26.963811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26363bea-2038-4b3e-aaba-382c1b2c4c23 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:26.973491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 764/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:27.807127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bda7-3b85-469d-a050-ec5fa10c11f4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:27.808021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bda7-3b85-469d-a050-ec5fa10c11f4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:27.808021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bda7-3b85-469d-a050-ec5fa10c11f4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:27.810176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:54:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:27.816431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1acdb-5626-428b-88e7-3de10314a5aa None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:27.816880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1acdb-5626-428b-88e7-3de10314a5aa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:27.817003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1acdb-5626-428b-88e7-3de10314a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:27.838920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-48d1acdb-5626-428b-88e7-3de10314a5aa None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:27.840123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48d1acdb-5626-428b-88e7-3de10314a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:27.850484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:28.009167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6bda7-3b85-469d-a050-ec5fa10c11f4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:28.031319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6bda7-3b85-469d-a050-ec5fa10c11f4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:28.038410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82a5e-f3c7-40bc-85c7-dde1d16239e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:28.039063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82a5e-f3c7-40bc-85c7-dde1d16239e0 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:28.039349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82a5e-f3c7-40bc-85c7-dde1d16239e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:28.039628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82a5e-f3c7-40bc-85c7-dde1d16239e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:28.048971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf82a5e-f3c7-40bc-85c7-dde1d16239e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:28.050636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf82a5e-f3c7-40bc-85c7-dde1d16239e0 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:28.061526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 762/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:32.276764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd353-efee-4d75-b767-7a09a420dad6 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:32.277415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd353-efee-4d75-b767-7a09a420dad6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:32.277415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfd353-efee-4d75-b767-7a09a420dad6 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:32.278744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:32.285291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597360b-cda6-4677-b028-c2d6531cd6e7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:32.285795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597360b-cda6-4677-b028-c2d6531cd6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:32.285893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597360b-cda6-4677-b028-c2d6531cd6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:32.305996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9597360b-cda6-4677-b028-c2d6531cd6e7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:32.307230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9597360b-cda6-4677-b028-c2d6531cd6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:32.316129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:32.358909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfd353-efee-4d75-b767-7a09a420dad6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:32.362519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-20cfd353-efee-4d75-b767-7a09a420dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:32.431646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfd353-efee-4d75-b767-7a09a420dad6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:32.435878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466181c9-2cba-4f68-82d1-7d3b96a8ead4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:32.436535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466181c9-2cba-4f68-82d1-7d3b96a8ead4 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:32.436821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466181c9-2cba-4f68-82d1-7d3b96a8ead4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:32.437101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466181c9-2cba-4f68-82d1-7d3b96a8ead4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:32.447285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466181c9-2cba-4f68-82d1-7d3b96a8ead4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:32.448726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466181c9-2cba-4f68-82d1-7d3b96a8ead4 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:32.454040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:32.459940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 767/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:34.527408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3f312-3566-47f8-adb6-4fb2ef7fa0fc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:34.528047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3f312-3566-47f8-adb6-4fb2ef7fa0fc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:34.528047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3f312-3566-47f8-adb6-4fb2ef7fa0fc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:34.529371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:34.534863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33b95d-6ab3-4d24-a3aa-de0bb5cf6a84 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:34.535317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33b95d-6ab3-4d24-a3aa-de0bb5cf6a84 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:34.535512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33b95d-6ab3-4d24-a3aa-de0bb5cf6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:34.555598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-eb33b95d-6ab3-4d24-a3aa-de0bb5cf6a84 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:34.556812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-eb33b95d-6ab3-4d24-a3aa-de0bb5cf6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:34.565301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:34.611934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3f312-3566-47f8-adb6-4fb2ef7fa0fc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:34.611934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-30f3f312-3566-47f8-adb6-4fb2ef7fa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:34.625448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3f312-3566-47f8-adb6-4fb2ef7fa0fc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:34.629629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174c2b-43cf-4271-8e06-4b3f642e295e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:34.630288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174c2b-43cf-4271-8e06-4b3f642e295e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:34.630577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174c2b-43cf-4271-8e06-4b3f642e295e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:34.630873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174c2b-43cf-4271-8e06-4b3f642e295e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:34.640763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6174c2b-43cf-4271-8e06-4b3f642e295e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:34.642221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6174c2b-43cf-4271-8e06-4b3f642e295e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:34.652609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 765/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:38.233577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43787d7-47c5-41f1-bc5f-3b44819a85fa None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:38.234543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43787d7-47c5-41f1-bc5f-3b44819a85fa None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:38.234543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43787d7-47c5-41f1-bc5f-3b44819a85fa None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:38.237193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:54:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:38.243823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db171-6414-40ac-8744-f1b6939ceca5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:38.244597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db171-6414-40ac-8744-f1b6939ceca5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:38.244797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db171-6414-40ac-8744-f1b6939ceca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:38.255511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=62 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:38.269284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a4db171-6414-40ac-8744-f1b6939ceca5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:38.270549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a4db171-6414-40ac-8744-f1b6939ceca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:38.279772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:38.596909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43787d7-47c5-41f1-bc5f-3b44819a85fa None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:38.599309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d43787d7-47c5-41f1-bc5f-3b44819a85fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:38.660964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43787d7-47c5-41f1-bc5f-3b44819a85fa None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:38.665065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcaba6-bd0e-444d-b28c-8fc7495472f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:38.665755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcaba6-bd0e-444d-b28c-8fc7495472f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:38.666039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcaba6-bd0e-444d-b28c-8fc7495472f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:38.666311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcaba6-bd0e-444d-b28c-8fc7495472f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:38.676066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcaba6-bd0e-444d-b28c-8fc7495472f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:38.677518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcaba6-bd0e-444d-b28c-8fc7495472f4 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:38.688066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 770/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:40.786577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc4af-64cb-48e8-bada-00bf8de20f8f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:40.787401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc4af-64cb-48e8-bada-00bf8de20f8f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:40.787401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fc4af-64cb-48e8-bada-00bf8de20f8f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:40.789671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:54:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:54:40.798764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5fa26-29e7-486d-b71d-e1a1927fbdf3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:40.799562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5fa26-29e7-486d-b71d-e1a1927fbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:40.799743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5fa26-29e7-486d-b71d-e1a1927fbdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:40.822282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ddc5fa26-29e7-486d-b71d-e1a1927fbdf3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:54:40.823507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ddc5fa26-29e7-486d-b71d-e1a1927fbdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:40.833911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:54:41.137820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fc4af-64cb-48e8-bada-00bf8de20f8f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:54:41.139905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5f3fc4af-64cb-48e8-bada-00bf8de20f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:54:41.154809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fc4af-64cb-48e8-bada-00bf8de20f8f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:54:41.158610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86bc77-94a1-4e9d-aa01-6b02bde1b459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:54:41.159254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86bc77-94a1-4e9d-aa01-6b02bde1b459 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:54:41.159533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86bc77-94a1-4e9d-aa01-6b02bde1b459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:54:41.159811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86bc77-94a1-4e9d-aa01-6b02bde1b459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:54:41.170192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86bc77-94a1-4e9d-aa01-6b02bde1b459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:54:41.171746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86bc77-94a1-4e9d-aa01-6b02bde1b459 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:54:41.182693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 768/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:54:50.815987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=32 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:51.178110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:12.955913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:12.957358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:12.957358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:12.979753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:12.981554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:12.993254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 772/1540] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.005844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.006475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.006475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.035515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.036786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.050654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 769/1541] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.054400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.067388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b4cc9-bcd8-42e6-9a4e-20532664f306 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.078119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.079240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.079761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.080251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.081315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.081894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.083782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e113e6-871f-4d87-816f-6641f4be27ff admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.102549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 773/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.113745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.124566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f818a3-9e18-4be2-bbb2-635756ef6719 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.136038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.136739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.137025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.137303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.138059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.140475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.156989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097443a-88e2-4436-a494-3733f1764b5f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.157782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097443a-88e2-4436-a494-3733f1764b5f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.158287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097443a-88e2-4436-a494-3733f1764b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.188986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 770/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:13.197268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.199660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5097443a-88e2-4436-a494-3733f1764b5f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.202581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5097443a-88e2-4436-a494-3733f1764b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.381640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5745c-706a-44c7-9302-637cb3872bcd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.383444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 774/1544] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.384817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd25d2-cb38-4575-bdeb-b2b458048864 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.385101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd25d2-cb38-4575-bdeb-b2b458048864 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.385372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd25d2-cb38-4575-bdeb-b2b458048864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.388936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.394639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.395207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.395708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.396633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.397946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:56:13.397946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:56:13.397946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:56:13.399634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a857b6-266d-4f60-b278-e1069b4024a8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.418552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-49fd25d2-cb38-4575-bdeb-b2b458048864 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.420127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-49fd25d2-cb38-4575-bdeb-b2b458048864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.429057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 775/1545] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.430883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a1ea-baf4-4bfe-ae35-f816dcfd5607 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.431520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a1ea-baf4-4bfe-ae35-f816dcfd5607 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.432011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a1ea-baf4-4bfe-ae35-f816dcfd5607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.433805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 771/1546] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:13.435551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3d65-2114-480c-b69f-4d93af2d0500 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.435915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3d65-2114-480c-b69f-4d93af2d0500 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.436198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3d65-2114-480c-b69f-4d93af2d0500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.452580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0b70a1ea-baf4-4bfe-ae35-f816dcfd5607 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.454217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0b70a1ea-baf4-4bfe-ae35-f816dcfd5607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.455469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-359a3d65-2114-480c-b69f-4d93af2d0500 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.456828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-359a3d65-2114-480c-b69f-4d93af2d0500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.464270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 776/1547] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.465798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 772/1548] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.466204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.466941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.467061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a075d5-19a4-4825-b901-5b3ae706a2c6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.467328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a075d5-19a4-4825-b901-5b3ae706a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.467748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.473657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a075d5-19a4-4825-b901-5b3ae706a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.492599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.493811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.494083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d1a075d5-19a4-4825-b901-5b3ae706a2c6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.495250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d1a075d5-19a4-4825-b901-5b3ae706a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.501961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 777/1549] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.502428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.504090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 773/1550] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.505538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377ffa9-5772-4ae1-b1d0-a2e56f2a9a62 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.505866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377ffa9-5772-4ae1-b1d0-a2e56f2a9a62 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.506149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377ffa9-5772-4ae1-b1d0-a2e56f2a9a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.518306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c725bb1-9814-4a3c-8453-b629784d2b9b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.522862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77a84-e0e1-4e36-a5a4-e67a57c692c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.523536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77a84-e0e1-4e36-a5a4-e67a57c692c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.523819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77a84-e0e1-4e36-a5a4-e67a57c692c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.524093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77a84-e0e1-4e36-a5a4-e67a57c692c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.524473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0377ffa9-5772-4ae1-b1d0-a2e56f2a9a62 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.524831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77a84-e0e1-4e36-a5a4-e67a57c692c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.525727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0377ffa9-5772-4ae1-b1d0-a2e56f2a9a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.526482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77a84-e0e1-4e36-a5a4-e67a57c692c8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.533589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 774/1551] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.534755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f572d4-848f-4e13-9fd9-992e0e0dabeb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.535096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f572d4-848f-4e13-9fd9-992e0e0dabeb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.535313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f572d4-848f-4e13-9fd9-992e0e0dabeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.537459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 778/1552] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:13.538912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521cfd6-4446-4952-8ba7-2a34aed566c1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.539204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521cfd6-4446-4952-8ba7-2a34aed566c1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.539485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521cfd6-4446-4952-8ba7-2a34aed566c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.555934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-29f572d4-848f-4e13-9fd9-992e0e0dabeb None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.556941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3521cfd6-4446-4952-8ba7-2a34aed566c1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.557133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29f572d4-848f-4e13-9fd9-992e0e0dabeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.558121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3521cfd6-4446-4952-8ba7-2a34aed566c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.569842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 779/1553] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.570263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 775/1554] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.571720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.572016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.572294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.574707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed97f4-46d0-4eb5-8aef-1782979a6dd5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.575002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed97f4-46d0-4eb5-8aef-1782979a6dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.575283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed97f4-46d0-4eb5-8aef-1782979a6dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.591879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.593049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-caed97f4-46d0-4eb5-8aef-1782979a6dd5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.593232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.594247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-caed97f4-46d0-4eb5-8aef-1782979a6dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.602883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 776/1555] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.602883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.605584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 780/1556] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.606596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.607032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.607162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.614325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631333dd-6263-4e07-97bc-2d0710254465 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.618953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.619615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.619900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.620176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.620910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.621217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.622263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:56:13.622263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:56:13.622263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:56:13.623145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.625754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.626937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.634884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 781/1557] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.635317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 777/1558] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.636252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.638508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.648788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9acc4-be56-4711-ac7f-46bdc7ce4b4c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.650133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e037e2-6e9b-414f-a230-db117bf308f2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.653986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.654653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.654932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.655204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.655672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.656344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.656559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.656672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.656893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.657694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.658036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.658203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.659970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7950f-ca88-4358-8c0d-33877b529119 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.668942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 778/1559] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:13.669787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.671935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 782/1560] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.673194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abba18-91fe-4544-8923-55fa058ca2f3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.673481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abba18-91fe-4544-8923-55fa058ca2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.673891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abba18-91fe-4544-8923-55fa058ca2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.684168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0402-769c-4579-8cd9-ec3e6de996ad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.689440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.690159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.690476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.690766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.691711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.691912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e6abba18-91fe-4544-8923-55fa058ca2f3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.692012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.693181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e6abba18-91fe-4544-8923-55fa058ca2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.693681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.700980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 783/1561] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.702214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.702762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.702762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.706258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 779/1562] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.707011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.717261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649382ef-ef8c-493c-90ba-e472c97e5d16 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.721074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:13.722481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.722660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:13.723141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.723428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.723710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.724426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.724737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.726380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.730865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 784/1563] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:13.731640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.740276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 780/1564] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.742243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf0bd4-f0f9-4320-9bae-82d9c8589da8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.742733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.747057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.747866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.747986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.748277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.749006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.749315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.750939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.752574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7d36-f34c-4666-96d6-f529ee4c0ccd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.757559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.758241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.758991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.759292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.759983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.762336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.763433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 785/1565] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.764174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.773862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1353-b193-445e-954f-1d813d01879a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.778596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.779475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.779756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.780035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] PATH_INFO: `/v3/projects/7307433ed6b744a3b84ad19a3a76a4ef/users/67629e17549a4a50a9d58da6a55dfb79/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.796016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7307433ed6b744a3b84ad19a3a76a4ef, user_id=67629e17549a4a50a9d58da6a55dfb79, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.797073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:56:13.797073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:56:13.797073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:56:13.797502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 781/1566] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:13.798475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.799039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.813365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 786/1567] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:13 2022] PUT /identity/v3/projects/7307433ed6b744a3b84ad19a3a76a4ef/users/67629e17549a4a50a9d58da6a55dfb79/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:13.814202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.817561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:13.846120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:13.870062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47553-3d16-49d7-8cf1-c5976ae9546d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.880471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d358b7-d40a-49d4-86c6-24dbeb57cb1c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.885020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.885711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.886038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.886321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.887119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:13.887416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.889026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.900741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 787/1568] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:13.901551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.911225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584fb8-193a-4949-b1c9-80091a2bafda admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:13.915741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.916387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.916677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.916958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.917750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.918783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:56:13.918783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:56:13.918783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:56:13.919970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.936404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:13.937180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:13.937492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:13.937834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:13.938606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:13.940874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:13.951604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 788/1569] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:13.951604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:13.970778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 782/1570] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:13.970778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.016493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e7c95-9a0a-4fdb-a155-ed67607b0e10 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.030308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bb6e8-d3db-4a4a-ad31-57a7c8fd5a63 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.035358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.036053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.036451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.036735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.037439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.039381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.067327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 783/1571] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.068287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.076313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.077012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.077316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.077586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.078369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:14.078675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.080267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.099734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 789/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:14.099734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.102506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f18671-a416-4d11-a6d9-dcdc0f248053 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.109248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:14.139054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d8b0-8bee-4b21-8cc3-94c452b1c438 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.142450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:14.144698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc045595-a154-4605-ba2b-42504351c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.145377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc045595-a154-4605-ba2b-42504351c6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.145685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc045595-a154-4605-ba2b-42504351c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.145985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc045595-a154-4605-ba2b-42504351c6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.146676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc045595-a154-4605-ba2b-42504351c6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.148654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc045595-a154-4605-ba2b-42504351c6d3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.163772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.164486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.164740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.164999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.165725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.167790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.175059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 784/1573] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.176413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.176842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.177047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.189068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 790/1574] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.190292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.199612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa448-8ab0-43a4-97d5-279d834078ca admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.206777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] MFA Rules not processed for user `67629e17549a4a50a9d58da6a55dfb79`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:14.207987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:14.258863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.259622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.259969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.260286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.261016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.262945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.274145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 785/1575] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:14.275283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.287363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147e54-a532-4cd5-ab00-978520cf92aa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.293911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 791/1576] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.293911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.294170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.294170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.294170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.294170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.294476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.296392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.317252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 786/1577] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.318410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.328451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f01c3-8bb7-446b-a49f-f4230637e1f6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.354662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d34df-1d7d-457c-988d-ef597ddcbda0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.359325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.360612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.360898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.361174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.361939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.364311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.388779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 792/1578] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.388998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.389124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.389217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.389217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.389217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.389217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.389803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.397219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2c1fd-2e61-4c00-ae7e-f658886860fe admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.403503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.404179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.404485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.404768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.405454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.407392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.409991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 787/1579] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.413855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.423988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d9496-1ceb-47be-816c-713def3673a6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.430615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.431286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.431571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.431849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.432541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.434511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.438894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 793/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.438894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.457710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 788/1581] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.458721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.463359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:14.465183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:14.469150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2a99-df16-4dc6-be39-96226897626a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.505121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4530554-db46-4be1-aa9f-85d5f8bc54ae admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.510087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.510803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.511113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.511389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.512173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.513869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.524566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 794/1582] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.525234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.535082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91562b-59bb-4116-a1fe-f53c97dbd327 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.537109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.537842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.538131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.538414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.539123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.539804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.540469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.540754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.541033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.541139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.541755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.543664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.566680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 795/1583] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.567793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 789/1584] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.567971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.568709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.582673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8870-674b-46bf-9fca-8e5d55a5c801 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.641040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a72df-8ea7-4531-af60-2be1ddbf573b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.643482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.644464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.644748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.645169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.646001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.646376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.647053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.647343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.647623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.647723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.648360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.650004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.657581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 796/1585] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.658419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.660647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 790/1586] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.661457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.668531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a71e3f-2680-448d-9d5c-16675c8073cf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.671248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777117-5840-4147-9378-faee1bbfbffd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.673355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.674055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.674344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.674725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.676082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.676205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.676732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.677016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.677294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.677765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.678025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.679919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.689060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 797/1587] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.689879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.700446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9530-3cc3-4d4e-a230-125091c5b465 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.703959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 791/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.704977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.707261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.708016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.708323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.708600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.709339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.711023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.715147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b456b35-65cf-4db4-be5f-a59e0c349ffe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.719685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.720336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.721349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.721552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 798/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.724805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.724964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.725072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.725072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.732395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052e92-43c7-4ded-b40f-9676a69de0fa admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.735494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 792/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.736460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.740667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.741453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.741785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.742067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.742772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.744770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.746461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77cc51-596e-46d6-9725-0f30fa133988 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.751066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.751717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.751987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.752258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.753166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.754860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.765559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 793/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.766435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 799/1592] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:14 2022] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:14.767275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.769958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.777526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7985caa-bbf7-4f21-ab8a-43916fefee93 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.779381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bc9c2-1f76-43f7-a37f-ceec00e493c5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.782169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.782992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.783375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.783748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.783847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.784541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.784853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.785104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.785363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.785862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.787248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.787431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.797339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 794/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.798235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.799301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 800/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.800301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.810160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1950-0b0e-4a41-8d0b-32f80642608d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.810310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3d94-d1e3-4039-93ee-ae7718a30a1c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.814789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.814944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.815491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.815682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.815942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.816059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.816349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.816452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.817091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.817210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.818730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.818837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.828844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 801/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.829699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 795/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.830091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.830923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.841154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147517-133f-46a1-8d47-3e07460629a7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.846173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.847340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.847463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.847651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21bc7-e193-486b-a288-761e380392fd admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.847757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] PATH_INFO: `/v3/projects/b42690d573304a2c93def8d98ffe261e/users/4705b076f9e34b1c92f0ac5e238c5292/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.852742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.853394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.853723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.854002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.854744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.856358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.862633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42690d573304a2c93def8d98ffe261e, user_id=4705b076f9e34b1c92f0ac5e238c5292, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.865301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.867155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 802/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.867989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.873632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:14.879597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118fed-725c-479d-8e69-688b0844bdf7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.881275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 796/1598] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:14 2022] PUT /identity/v3/projects/b42690d573304a2c93def8d98ffe261e/users/4705b076f9e34b1c92f0ac5e238c5292/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:14.882383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.906334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:14.946101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.946775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.947058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.947363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.948096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.949720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.951877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0623-17b4-44aa-bbdd-628ea7b7758e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.956951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.957678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.957965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.958239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.958971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.959858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 803/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.963650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:14.963979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.970281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad931-a963-4662-844e-24339d5eb420 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.974665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 797/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:14.974665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:14.978411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.979373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.979727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.980005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] PATH_INFO: `/v3/projects/3e466fc6b98d46e4a91e40ff65f5f7ef/users/eb9ab932557f42628c2fdd2c363e8716/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.981809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598726-b8dc-422f-921f-45d40cc86809 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:14.986759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:14.987726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:14.988086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:14.988369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] PATH_INFO: `/v3/projects/c9ff40710f1740c4a0bb420c4d604b8c/users/cdc4a7650e904ba990d9ced0fda14bff/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:14.995484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e466fc6b98d46e4a91e40ff65f5f7ef, user_id=eb9ab932557f42628c2fdd2c363e8716, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:14.998173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.003643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ff40710f1740c4a0bb420c4d604b8c, user_id=cdc4a7650e904ba990d9ced0fda14bff, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.006525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.012629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 804/1601] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:14 2022] PUT /identity/v3/projects/3e466fc6b98d46e4a91e40ff65f5f7ef/users/eb9ab932557f42628c2fdd2c363e8716/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.013699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.030839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 798/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:14 2022] PUT /identity/v3/projects/c9ff40710f1740c4a0bb420c4d604b8c/users/cdc4a7650e904ba990d9ced0fda14bff/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.032177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.082012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff6cd3-c8f9-4b91-90a6-ef3dc5910326 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.096094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcab79-035c-4a49-904b-6d0a163f9223 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.101179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.102071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.102348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.102617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] PATH_INFO: `/v3/projects/46979fe7d4ab457c9e8e8ccebfa3920f/users/761bdea435cf43f98b28b371723f9478/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.117982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46979fe7d4ab457c9e8e8ccebfa3920f, user_id=761bdea435cf43f98b28b371723f9478, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.120736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.134789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 799/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:15 2022] PUT /identity/v3/projects/46979fe7d4ab457c9e8e8ccebfa3920f/users/761bdea435cf43f98b28b371723f9478/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.135701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.140511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561305e4-4563-4b8b-9018-0b992c2cf7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.141220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561305e4-4563-4b8b-9018-0b992c2cf7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.141506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561305e4-4563-4b8b-9018-0b992c2cf7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.141813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561305e4-4563-4b8b-9018-0b992c2cf7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.142559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561305e4-4563-4b8b-9018-0b992c2cf7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.144426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561305e4-4563-4b8b-9018-0b992c2cf7a4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.155035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 805/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:15.156184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558839-4262-41c6-a028-763f77118ee0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.156477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558839-4262-41c6-a028-763f77118ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.156751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558839-4262-41c6-a028-763f77118ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.174599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-63558839-4262-41c6-a028-763f77118ee0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.175842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-63558839-4262-41c6-a028-763f77118ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.187957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.200322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e42eb3-0ddf-4c3b-895d-190a223b4f8e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.205248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.206344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.206632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.206909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] PATH_INFO: `/v3/projects/b7882d882aa04d77b94acf8c2e3b73a2/users/013a84047a1d4e5e89f0f17b1048e519/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.210884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.222457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7882d882aa04d77b94acf8c2e3b73a2, user_id=013a84047a1d4e5e89f0f17b1048e519, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.225141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.238154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 806/1605] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.246180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 800/1606] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:15 2022] PUT /identity/v3/projects/b7882d882aa04d77b94acf8c2e3b73a2/users/013a84047a1d4e5e89f0f17b1048e519/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.246892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63558839-4262-41c6-a028-763f77118ee0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.247000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.255051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63558839-4262-41c6-a028-763f77118ee0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.308826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec7cc6-886d-47d1-9aab-b3628ffb934c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.313326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7780d9-e209-48e2-b513-f19f0c9814c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.314292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7780d9-e209-48e2-b513-f19f0c9814c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.314578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7780d9-e209-48e2-b513-f19f0c9814c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.314847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea20f7-700d-41e0-b333-4452c70dbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.314985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7780d9-e209-48e2-b513-f19f0c9814c6 admin admin] PATH_INFO: `/v3/projects/e040231ab66c4fa5a130d16231b419c4/users/18f8086121374e97b5c7de429ed37f65/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.315990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea20f7-700d-41e0-b333-4452c70dbb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.316403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea20f7-700d-41e0-b333-4452c70dbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.316813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea20f7-700d-41e0-b333-4452c70dbb4c admin admin] PATH_INFO: `/v3/projects/fb7c88a240e740d8b74c3cc48e8dc5f6/users/e50d226291da44b5a2c35f79726ff3e7/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.330644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7780d9-e209-48e2-b513-f19f0c9814c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e040231ab66c4fa5a130d16231b419c4, user_id=18f8086121374e97b5c7de429ed37f65, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.331670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea20f7-700d-41e0-b333-4452c70dbb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7c88a240e740d8b74c3cc48e8dc5f6, user_id=e50d226291da44b5a2c35f79726ff3e7, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.334370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea20f7-700d-41e0-b333-4452c70dbb4c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.334484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7780d9-e209-48e2-b513-f19f0c9814c6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.350679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 801/1607] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:15 2022] PUT /identity/v3/projects/e040231ab66c4fa5a130d16231b419c4/users/18f8086121374e97b5c7de429ed37f65/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.351068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 807/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:15 2022] PUT /identity/v3/projects/fb7c88a240e740d8b74c3cc48e8dc5f6/users/e50d226291da44b5a2c35f79726ff3e7/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.352534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7aac9-c6bd-4f58-930b-940ba15ac3b8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.352824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7aac9-c6bd-4f58-930b-940ba15ac3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.353124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7aac9-c6bd-4f58-930b-940ba15ac3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.355975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.356296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.356565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.370651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-38e7aac9-c6bd-4f58-930b-940ba15ac3b8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.371843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-38e7aac9-c6bd-4f58-930b-940ba15ac3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.383401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] MFA Rules not processed for user `eb9ab932557f42628c2fdd2c363e8716`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.384591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.431938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 808/1609] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.433315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf503312-9d2e-44fa-a9fc-19ffca535987 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.433707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf503312-9d2e-44fa-a9fc-19ffca535987 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.434059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf503312-9d2e-44fa-a9fc-19ffca535987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.449993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 802/1610] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.451015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.451723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bf503312-9d2e-44fa-a9fc-19ffca535987 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.452931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bf503312-9d2e-44fa-a9fc-19ffca535987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.461586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 809/1611] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.464785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48767521-8879-4345-8dbc-ac1896526fd2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.464893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.464893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.464893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.467400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.468298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.468553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.469062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] PATH_INFO: `/v3/projects/a93fc1cf773d4167a1a358fd9b2ba6a1/users/ab0db951daf34ae488291dd6e63a11f3/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.484202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93fc1cf773d4167a1a358fd9b2ba6a1, user_id=ab0db951daf34ae488291dd6e63a11f3, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.487529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.493865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] MFA Rules not processed for user `013a84047a1d4e5e89f0f17b1048e519`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.495215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.503892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 803/1612] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:15 2022] PUT /identity/v3/projects/a93fc1cf773d4167a1a358fd9b2ba6a1/users/ab0db951daf34ae488291dd6e63a11f3/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.504164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.531336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.552552 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.560768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5bd5-462d-48e8-83c6-08f71a157ccb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.567024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e110dc0-e6d2-4458-a69e-e2e4db0f1031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.567695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110dc0-e6d2-4458-a69e-e2e4db0f1031 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.568008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110dc0-e6d2-4458-a69e-e2e4db0f1031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.568284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110dc0-e6d2-4458-a69e-e2e4db0f1031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.577759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 810/1613] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.578600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.642327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e110dc0-e6d2-4458-a69e-e2e4db0f1031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.644458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e110dc0-e6d2-4458-a69e-e2e4db0f1031 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.654141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 804/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:15.655427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.655716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.655998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.658122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d026-fa4b-4798-995c-80a2383d9c4a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.663592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.664305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.664562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.664883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.665646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.667471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.676224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.677927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.678473 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 811/1615] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:15.679355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.689801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a07e8-23f0-4b0b-8d41-96c3981df813 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.693145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 805/1616] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.694022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758b0a-0395-46c8-83a8-389a42442d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.694181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.694866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758b0a-0395-46c8-83a8-389a42442d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.695240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758b0a-0395-46c8-83a8-389a42442d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.695580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758b0a-0395-46c8-83a8-389a42442d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.704739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f7a2c-d2bd-4178-ad33-ca9a63e05879 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.705864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758b0a-0395-46c8-83a8-389a42442d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.707657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758b0a-0395-46c8-83a8-389a42442d43 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.709077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411fb0e-2979-4d59-becc-9f34cf1baab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.709843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411fb0e-2979-4d59-becc-9f34cf1baab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.710131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411fb0e-2979-4d59-becc-9f34cf1baab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.710409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411fb0e-2979-4d59-becc-9f34cf1baab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.718587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 812/1617] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:15.719831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35206-515a-4f5e-bccb-da87ad3ee594 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.720242 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35206-515a-4f5e-bccb-da87ad3ee594 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.720357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411fb0e-2979-4d59-becc-9f34cf1baab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.720615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35206-515a-4f5e-bccb-da87ad3ee594 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.721969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411fb0e-2979-4d59-becc-9f34cf1baab3 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.722356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 813/1618] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 23 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:15.723476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995a39-15e4-4e70-a297-dbdda35fed10 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.723824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995a39-15e4-4e70-a297-dbdda35fed10 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.724256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995a39-15e4-4e70-a297-dbdda35fed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.734025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 806/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:15.735701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809232f9-fb25-4d9b-83b5-34fc75447b9e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.735988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809232f9-fb25-4d9b-83b5-34fc75447b9e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.736266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809232f9-fb25-4d9b-83b5-34fc75447b9e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.738027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 807/1620] 10.222.0.27 () {54 vars in 961 bytes} [Thu Jun 23 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:15.738819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809232f9-fb25-4d9b-83b5-34fc75447b9e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.751604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809232f9-fb25-4d9b-83b5-34fc75447b9e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.753162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cb995a39-15e4-4e70-a297-dbdda35fed10 None None] MFA Rules not processed for user `ab0db951daf34ae488291dd6e63a11f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.755255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cb995a39-15e4-4e70-a297-dbdda35fed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.756909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.757946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.758210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.758583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] PATH_INFO: `/v3/projects/e040231ab66c4fa5a130d16231b419c4/users/18f8086121374e97b5c7de429ed37f65/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.760668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e040231ab66c4fa5a130d16231b419c4, user_id=18f8086121374e97b5c7de429ed37f65, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.763668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.776732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 808/1621] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:15 2022] PUT /identity/v3/projects/e040231ab66c4fa5a130d16231b419c4/users/18f8086121374e97b5c7de429ed37f65/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:15.787345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.841222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 814/1622] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.842843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb72f3-2bbc-4885-bd48-0fac17b0e37e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.843232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb72f3-2bbc-4885-bd48-0fac17b0e37e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.843728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb72f3-2bbc-4885-bd48-0fac17b0e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.857627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0aca-b8b3-4da2-8f11-53a7e022fc2f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:15.861989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4591b5-5245-4588-8e54-7dd1c490c58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:15.862911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4591b5-5245-4588-8e54-7dd1c490c58f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.863111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4591b5-5245-4588-8e54-7dd1c490c58f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.863389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4591b5-5245-4588-8e54-7dd1c490c58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.867224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-07eb72f3-2bbc-4885-bd48-0fac17b0e37e None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.868530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-07eb72f3-2bbc-4885-bd48-0fac17b0e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.921980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.927062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.936183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4591b5-5245-4588-8e54-7dd1c490c58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:15.937702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4591b5-5245-4588-8e54-7dd1c490c58f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:15.948073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 809/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:15.949475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.949891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.950109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.950736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 815/1624] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.952064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:15.952353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:15.952635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:15.970018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.971343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.983811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 810/1625] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:15.985179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:15.992688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] MFA Rules not processed for user `18f8086121374e97b5c7de429ed37f65`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:15.994049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:15.997213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1066a-3484-4aad-bad9-b222a33fd37a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.002933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.003823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.004204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.004581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.005422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.007551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.038705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 811/1626] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:16.039786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.077039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 816/1627] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:16.078365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.094388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce954cb-0523-4b94-b2d7-0887101d12fd None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.151243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d7b4c-0b28-45fe-a27d-df5bed81e4cc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.163637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.164661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.165683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.166042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.185068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.185780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.186175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.186459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.250731 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.254170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.285494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 812/1628] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:16.288545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.294733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.296571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.310327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 817/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:16.311259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.330605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:16.401197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95579bda-5be5-4e24-95ce-21bc997e5966 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.416668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fbefa-79af-415d-b3cc-363615170526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.417403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fbefa-79af-415d-b3cc-363615170526 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.417875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fbefa-79af-415d-b3cc-363615170526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.418161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fbefa-79af-415d-b3cc-363615170526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.456212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82123979-d3fe-445a-9970-9f50e9b3f6d5 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.473021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.473868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.474257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.474710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.475515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.477557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.494194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:16.524909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fbefa-79af-415d-b3cc-363615170526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.528467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fbefa-79af-415d-b3cc-363615170526 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.536082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 813/1630] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:16 2022] POST /identity/v3/users => generated 308 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:16.537519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.555257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 818/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:16.576317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156180c-1c9c-46c9-8afc-945a7a345235 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.584812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6059-0ebb-4f64-8ad6-1d38f3f5ea86 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.585036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6059-0ebb-4f64-8ad6-1d38f3f5ea86 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.585287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6059-0ebb-4f64-8ad6-1d38f3f5ea86 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.587741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 819/1632] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 23 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:56:16.591298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.592203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.592596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.592981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.593860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.599166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.603055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.603055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.607412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.632294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:16.644996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 814/1633] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:16.644996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.645312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:16.669686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572aa73-07cb-4a1c-a4e5-c88a68762c9b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.670200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 820/1634] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:16.677207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.690271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.692060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.692451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.692871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] PATH_INFO: `/v3/users/67629e17549a4a50a9d58da6a55dfb79` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.696485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67629e17549a4a50a9d58da6a55dfb79)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.698899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aecd1-44a2-4069-b235-15d7e55d7268 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.699998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.714190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:16.717356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.718476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.718476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] PATH_INFO: `/v3/projects/8e10fb544d1343379f8bc142c4b0a902/users/608bb6102a984de5a9aebdbf30deb2bb/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.761646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e10fb544d1343379f8bc142c4b0a902, user_id=608bb6102a984de5a9aebdbf30deb2bb, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:16.766772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:16.795349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 821/1635] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:16 2022] PUT /identity/v3/projects/8e10fb544d1343379f8bc142c4b0a902/users/608bb6102a984de5a9aebdbf30deb2bb/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:16.797549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.829070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67629e17549a4a50a9d58da6a55dfb79'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:16.841879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67629e17549a4a50a9d58da6a55dfb79'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:16.843379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67629e17549a4a50a9d58da6a55dfb79'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:16.855666 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67629e17549a4a50a9d58da6a55dfb79'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:16.856623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-06e3263b-035d-4bbb-a591-befab31f2125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67629e17549a4a50a9d58da6a55dfb79'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:16.905758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 815/1636] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:16 2022] DELETE /identity/v3/users/67629e17549a4a50a9d58da6a55dfb79 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:16.906659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176a31-c590-421a-b405-009c416204e2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:16.910783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1662c-b516-4c23-9f0a-fcb4d2872427 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:16.911072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1662c-b516-4c23-9f0a-fcb4d2872427 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:16.911353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1662c-b516-4c23-9f0a-fcb4d2872427 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:16.914827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 816/1637] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 23 11:56:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:16.920149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1662c-b516-4c23-9f0a-fcb4d2872427 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:16.923606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-77e1662c-b516-4c23-9f0a-fcb4d2872427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.024118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:17.036607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:17.037460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.038143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.039007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.043315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.079997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1662c-b516-4c23-9f0a-fcb4d2872427 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:17.085250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3593e5-820e-4f37-b8e9-10ba819d552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:17.085991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3593e5-820e-4f37-b8e9-10ba819d552d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.086277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3593e5-820e-4f37-b8e9-10ba819d552d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.086554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3593e5-820e-4f37-b8e9-10ba819d552d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.087642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3593e5-820e-4f37-b8e9-10ba819d552d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:17.090080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3593e5-820e-4f37-b8e9-10ba819d552d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:17.111718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 817/1638] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:17.113655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.113953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.114281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.128800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:17.130442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff52ee-a116-414a-a44f-6dde065209a4 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:17.135675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:17.136937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.142750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 822/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:17.144285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50ba0f-4ea1-47fd-b1a6-b6ad6b85eac3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.144678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50ba0f-4ea1-47fd-b1a6-b6ad6b85eac3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.145056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50ba0f-4ea1-47fd-b1a6-b6ad6b85eac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.150876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 818/1640] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:17.152631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:17.165326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbfbb7-c2f4-4935-8b6e-6794cb231d6e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:17.170941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:17.172337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.172630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.172907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] PATH_INFO: `/v3/projects/8e10fb544d1343379f8bc142c4b0a902/users/608bb6102a984de5a9aebdbf30deb2bb/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.173725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dd50ba0f-4ea1-47fd-b1a6-b6ad6b85eac3 None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:17.175330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dd50ba0f-4ea1-47fd-b1a6-b6ad6b85eac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.176406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e10fb544d1343379f8bc142c4b0a902, user_id=608bb6102a984de5a9aebdbf30deb2bb, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:17.179881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:17.195596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 823/1642] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:56:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:17.205289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.206140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.207663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.212114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 819/1642] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:17 2022] PUT /identity/v3/projects/8e10fb544d1343379f8bc142c4b0a902/users/608bb6102a984de5a9aebdbf30deb2bb/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:17.223760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:17.226476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.256755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] MFA Rules not processed for user `608bb6102a984de5a9aebdbf30deb2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:17.258457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.308590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:17.361955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 824/1643] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:17.361955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:17.363559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:17.375336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625f15-aa38-4b2f-885b-176da54cfaa8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:17.391148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703db516-0e39-4575-b822-a8554719934d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:17.392156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703db516-0e39-4575-b822-a8554719934d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.392571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703db516-0e39-4575-b822-a8554719934d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.393010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703db516-0e39-4575-b822-a8554719934d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.488661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703db516-0e39-4575-b822-a8554719934d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:17.490742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703db516-0e39-4575-b822-a8554719934d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:17.500403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62237a5-75cc-4c48-9007-e98f2b56804d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:17.505521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:17.506293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:17.507397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:17.508044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:17.517339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 820/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:17.578482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:17.695356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:17.697437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:17.723139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 825/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:18.040206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703db516-0e39-4575-b822-a8554719934d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:18.040206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-703db516-0e39-4575-b822-a8554719934d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:18.058904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703db516-0e39-4575-b822-a8554719934d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:18.070008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:18.070696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:18.070980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:18.071261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:18.102091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:18.104203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:18.128615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 821/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:18.678668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:18.681987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:18.831480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bbf42-a252-45e1-bf97-0344627e0e60 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:18.831480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:18.831480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:18.831480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:18.834193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] PATH_INFO: `/v3/projects/7307433ed6b744a3b84ad19a3a76a4ef` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:18.834193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7307433ed6b744a3b84ad19a3a76a4ef)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:18.834193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:18.861533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7307433ed6b744a3b84ad19a3a76a4ef', 'request_id': 'req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:18.874217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7307433ed6b744a3b84ad19a3a76a4ef', 'request_id': 'req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:18.885804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7307433ed6b744a3b84ad19a3a76a4ef', 'request_id': 'req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:18.907601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] The token cache is being invalidate because project 7307433ed6b744a3b84ad19a3a76a4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:18.908471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:18.909402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:18.913070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 826/1647] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:18 2022] DELETE /identity/v3/projects/7307433ed6b744a3b84ad19a3a76a4ef => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:18.923073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:18.952098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:18.955216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:18.962457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17961b2-1384-4d61-acf6-979808bc0b1b service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:19.111282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:19.116393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:19.117132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:19.118252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] PATH_INFO: `/v3/users/18f8086121374e97b5c7de429ed37f65` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:19.120850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f8086121374e97b5c7de429ed37f65)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:19.127055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:19.149275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ffc9c-f5f6-46b4-a02d-8320ca3376b5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:19.160398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:19.161760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:19.162290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:19.164085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] PATH_INFO: `/v3/users/ab0db951daf34ae488291dd6e63a11f3` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:19.166671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0db951daf34ae488291dd6e63a11f3)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:19.171078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: WARNING py.warnings [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:56:19.171078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: warnings.warn(msg) Jun 23 11:56:19.171078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: Jun 23 11:56:19.172293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:19.229250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f8086121374e97b5c7de429ed37f65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.244467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f8086121374e97b5c7de429ed37f65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.245342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f8086121374e97b5c7de429ed37f65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.247407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:19.259461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f8086121374e97b5c7de429ed37f65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.260326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fdf6bdd5-8aab-4aff-ad21-79bd8eec7233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f8086121374e97b5c7de429ed37f65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.305474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 822/1648] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:18 2022] DELETE /identity/v3/users/18f8086121374e97b5c7de429ed37f65 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:19.308926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:19.311531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0db951daf34ae488291dd6e63a11f3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.323124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0db951daf34ae488291dd6e63a11f3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.342474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0db951daf34ae488291dd6e63a11f3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.343364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0db951daf34ae488291dd6e63a11f3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.366979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0db951daf34ae488291dd6e63a11f3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:19.379901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 827/1649] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:18 2022] DELETE /identity/v3/users/ab0db951daf34ae488291dd6e63a11f3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:19.386222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:19.386829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:19.387224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:19.417893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:19.421753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:19.552805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 823/1650] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:19.567156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:19.568635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:19.796468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf08d-1426-4277-8a85-505e667f56ad admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:19.803907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:19.805909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:19.806461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:19.807122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:19.829786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:19.833024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:19.845414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 828/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:21.008929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:21.012795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:21.034648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012be63-8f04-49b5-a396-4fba715bd4eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:21.052431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:21.054721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.054721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.055033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] PATH_INFO: `/v3/projects/e040231ab66c4fa5a130d16231b419c4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:21.058843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e040231ab66c4fa5a130d16231b419c4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:21.116687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:56:21.116687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: warnings.warn(msg) Jun 23 11:56:21.116687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: Jun 23 11:56:21.116687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:21.132133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:21.133850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:21.165226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a55ee-511d-469f-8c71-be04e089b4a4 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:21.179467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:21.182730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.184677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.185837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] PATH_INFO: `/v3/projects/a93fc1cf773d4167a1a358fd9b2ba6a1` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:21.191071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93fc1cf773d4167a1a358fd9b2ba6a1)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:21.193170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:21.282256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e040231ab66c4fa5a130d16231b419c4', 'request_id': 'req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.301586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e040231ab66c4fa5a130d16231b419c4', 'request_id': 'req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.307192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93fc1cf773d4167a1a358fd9b2ba6a1', 'request_id': 'req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.332017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e040231ab66c4fa5a130d16231b419c4', 'request_id': 'req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.349542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93fc1cf773d4167a1a358fd9b2ba6a1', 'request_id': 'req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.362191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93fc1cf773d4167a1a358fd9b2ba6a1', 'request_id': 'req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.362585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] The token cache is being invalidate because project e040231ab66c4fa5a130d16231b419c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:21.362940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.364218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.373585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 824/1652] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:21 2022] DELETE /identity/v3/projects/e040231ab66c4fa5a130d16231b419c4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:21.374974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:21.377320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:21.383824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] The token cache is being invalidate because project a93fc1cf773d4167a1a358fd9b2ba6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:21.384502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.385476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3af4cc6b-3d71-41d5-8bfd-bfad8ae56421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.387757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 829/1653] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:21 2022] DELETE /identity/v3/projects/a93fc1cf773d4167a1a358fd9b2ba6a1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:21.392001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.392307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.392586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:21.456271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:21.458943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:21.524004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:21.533247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9efd1-3eda-4fef-b9ae-ba52b4c9d3f7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:21.574574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:21.604544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 830/1654] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:21.606063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:21.607042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:21.661965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a808e9-5bf3-44ad-b301-7e53586e83f1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:21.679061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:21.682001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.683007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.683662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] PATH_INFO: `/v3/users/608bb6102a984de5a9aebdbf30deb2bb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:21.688926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=608bb6102a984de5a9aebdbf30deb2bb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:21.693254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:21.740223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:21.744377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.744679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.744967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] PATH_INFO: `/v3/users/eb9ab932557f42628c2fdd2c363e8716` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:21.748713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9ab932557f42628c2fdd2c363e8716)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:21.752918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:21.795818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608bb6102a984de5a9aebdbf30deb2bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.806909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608bb6102a984de5a9aebdbf30deb2bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.822666 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608bb6102a984de5a9aebdbf30deb2bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.823911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608bb6102a984de5a9aebdbf30deb2bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.855335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60e27099-5d4c-47f8-b59a-52de76a4df4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608bb6102a984de5a9aebdbf30deb2bb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.878489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 831/1655] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:21 2022] DELETE /identity/v3/users/608bb6102a984de5a9aebdbf30deb2bb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:21.880480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.880974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.881488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:21.908124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9ab932557f42628c2fdd2c363e8716'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.912443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:21.915367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:21.930561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9ab932557f42628c2fdd2c363e8716'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.931339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9ab932557f42628c2fdd2c363e8716'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.951277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9ab932557f42628c2fdd2c363e8716'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.951966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-242d74ae-a118-401b-8fa9-a7c47146dd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9ab932557f42628c2fdd2c363e8716'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:21.982941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 825/1656] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:21 2022] DELETE /identity/v3/users/eb9ab932557f42628c2fdd2c363e8716 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:21.991616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:21.992136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:21.993129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.047330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:22.051391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:22.052718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 832/1657] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:22.056878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.080445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29476cd-39ab-438e-a949-2d92abf8ad43 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.196664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.197355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.197659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.197947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.199310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:22.199803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.201657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.203676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:22.223608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 833/1658] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:22.227707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.247664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3b3da-9fb3-473c-843e-ac43909a580b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.256105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.256869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.257227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.257692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.258485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.261314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.310990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 826/1659] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:22.320232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 834/1660] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:22 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:56:22.348821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.367908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d99c-8adc-4763-8c8c-85e9a7033e64 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.399058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:22.477859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.480623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:22.491244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.491960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.492244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.492519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.493314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.501283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.550047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 827/1661] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:22 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:22.554374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.571064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92d92f-9124-4463-afe9-e79cf5eb9784 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.588390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.589114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.589395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.589844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.591632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.593335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.620131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 828/1662] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:22.621190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.657434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48798167-a5d0-4e8d-93b9-ba6fe1d4ce13 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.673612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b274-3c6e-4eeb-82f3-e163fe6d27f8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.678681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.679526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.679848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.680259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.692073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.692470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dd2a0-c883-4f98-81b5-ed4632788aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.693169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd2a0-c883-4f98-81b5-ed4632788aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.694241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd2a0-c883-4f98-81b5-ed4632788aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.694375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.694469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd2a0-c883-4f98-81b5-ed4632788aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.694805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dd2a0-c883-4f98-81b5-ed4632788aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.699440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dd2a0-c883-4f98-81b5-ed4632788aa2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.712778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 835/1663] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:56:22.726055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 829/1664] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:22.730845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:22.744795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c9e31-3e9e-42de-9c6f-3c265e719098 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:22.776755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f44475-0319-4109-b612-962528063397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:22.777814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f44475-0319-4109-b612-962528063397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.778153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f44475-0319-4109-b612-962528063397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.778426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f44475-0319-4109-b612-962528063397 admin admin] PATH_INFO: `/v3/projects/4f83da30ae934ced83dad02264c3e9c2/users/52a87762ec634c8ab4ec9b1dbbfb5e50/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.804750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f44475-0319-4109-b612-962528063397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f83da30ae934ced83dad02264c3e9c2, user_id=52a87762ec634c8ab4ec9b1dbbfb5e50, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:22.808539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f44475-0319-4109-b612-962528063397 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:22.834264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 836/1665] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:22 2022] PUT /identity/v3/projects/4f83da30ae934ced83dad02264c3e9c2/users/52a87762ec634c8ab4ec9b1dbbfb5e50/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:22.844791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:22.845124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:22.845472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:22.918206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] MFA Rules not processed for user `52a87762ec634c8ab4ec9b1dbbfb5e50`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:22.919538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:23.085792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 830/1666] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:23.091043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f44475-0319-4109-b612-962528063397 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:23.258704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f44475-0319-4109-b612-962528063397 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:23.274766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:23.275465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:23.275752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:23.276034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:23.277463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:23.279468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:23.380134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 837/1667] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:23 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:23.381408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:23.402916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065c014-4e64-48a6-b706-a48dc0d4b7fa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:23.574439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:23.575162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:23.575448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:23.575728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:23.576447 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:23.578584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:23.652540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 831/1668] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:23 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:23.656336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:23.682779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b520ed-4fa5-4646-b68f-db17d21f3323 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:23.695455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:23.696317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:23.696571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:23.698347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:23.699136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:23.703722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:23.715590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:23.719142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:23.753283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1144a-86f7-4892-9486-29f88009a551 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:23.756507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 838/1669] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:23.757442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:23.786794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:23.789823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:23.791310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:23.795617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35681734-e9ca-4156-843d-4f471ed694de admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:23.796334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] PATH_INFO: `/v3/projects/8e10fb544d1343379f8bc142c4b0a902` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:23.800312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e10fb544d1343379f8bc142c4b0a902)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:23.804448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:23.834186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:23.835640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:23.835640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:23.835640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] PATH_INFO: `/v3/projects/fbf2423a183e4d22a1475d1261d4de2b/users/fd4f6fe3d8264a39aab48a096d11ad7b/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:23.864155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:23.895281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf2423a183e4d22a1475d1261d4de2b, user_id=fd4f6fe3d8264a39aab48a096d11ad7b, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:23.903171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:23.923283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:23.933864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 839/1670] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:23 2022] PUT /identity/v3/projects/fbf2423a183e4d22a1475d1261d4de2b/users/fd4f6fe3d8264a39aab48a096d11ad7b/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:23.943036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:23.970627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e10fb544d1343379f8bc142c4b0a902', 'request_id': 'req-3164f2d4-4113-4162-83dd-129909266632'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:23.992829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e10fb544d1343379f8bc142c4b0a902', 'request_id': 'req-3164f2d4-4113-4162-83dd-129909266632'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.007816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e10fb544d1343379f8bc142c4b0a902', 'request_id': 'req-3164f2d4-4113-4162-83dd-129909266632'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.044194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] The token cache is being invalidate because project 8e10fb544d1343379f8bc142c4b0a902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:24.045079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.046412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.048910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 832/1671] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:23 2022] DELETE /identity/v3/projects/8e10fb544d1343379f8bc142c4b0a902 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:24.050644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:24.053358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:24.092593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00305618-d453-4d91-be9d-cb641fce2df1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:24.175937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164f2d4-4113-4162-83dd-129909266632 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:24.182119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:24.182889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.182990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.183264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] PATH_INFO: `/v3/users/013a84047a1d4e5e89f0f17b1048e519` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.184479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013a84047a1d4e5e89f0f17b1048e519)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:24.186888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:24.273960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013a84047a1d4e5e89f0f17b1048e519'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.282369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3653d34-7adc-4835-99bc-c99e8527c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:24.284166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653d34-7adc-4835-99bc-c99e8527c268 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.284406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013a84047a1d4e5e89f0f17b1048e519'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.284870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653d34-7adc-4835-99bc-c99e8527c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.285214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013a84047a1d4e5e89f0f17b1048e519'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.285907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653d34-7adc-4835-99bc-c99e8527c268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.286893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3653d34-7adc-4835-99bc-c99e8527c268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:24.289519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3653d34-7adc-4835-99bc-c99e8527c268 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:24.299108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013a84047a1d4e5e89f0f17b1048e519'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.299842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013a84047a1d4e5e89f0f17b1048e519'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:24.306230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 840/1672] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:24.307994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ece79-4ef8-4e85-a8ac-5c56439b947f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.308526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ece79-4ef8-4e85-a8ac-5c56439b947f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.309040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ece79-4ef8-4e85-a8ac-5c56439b947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.343300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a33ece79-4ef8-4e85-a8ac-5c56439b947f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:24.345618 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a33ece79-4ef8-4e85-a8ac-5c56439b947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:24.349147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 833/1673] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:24 2022] DELETE /identity/v3/users/013a84047a1d4e5e89f0f17b1048e519 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:24.350248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:24.353825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:24.397439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:24.469676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 841/1674] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:24.471165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb09b-9c3e-4af7-9e7f-ab0a777f40b6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.474420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb09b-9c3e-4af7-9e7f-ab0a777f40b6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.476080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eb09b-9c3e-4af7-9e7f-ab0a777f40b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.535915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-113eb09b-9c3e-4af7-9e7f-ab0a777f40b6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:24.538737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-113eb09b-9c3e-4af7-9e7f-ab0a777f40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:24.553529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e5a8-b619-47e8-b3ac-94395a230819 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:24.568279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 842/1675] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:24.570128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.574449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.574941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.575045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3500c65-c65e-4fd6-995c-011ecb3bc0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:24.575974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500c65-c65e-4fd6-995c-011ecb3bc0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.576268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500c65-c65e-4fd6-995c-011ecb3bc0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.576552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3500c65-c65e-4fd6-995c-011ecb3bc0e1 admin admin] PATH_INFO: `/v3/projects/fbf2423a183e4d22a1475d1261d4de2b/users/fd4f6fe3d8264a39aab48a096d11ad7b/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.587748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500c65-c65e-4fd6-995c-011ecb3bc0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf2423a183e4d22a1475d1261d4de2b, user_id=fd4f6fe3d8264a39aab48a096d11ad7b, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:24.600523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3500c65-c65e-4fd6-995c-011ecb3bc0e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:24.626907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:24.632644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:24.638145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 834/1676] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:24 2022] PUT /identity/v3/projects/fbf2423a183e4d22a1475d1261d4de2b/users/fd4f6fe3d8264a39aab48a096d11ad7b/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:24.652606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d706-481e-4dd4-83da-583e219a907e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:24.652825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d706-481e-4dd4-83da-583e219a907e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:24.653042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d706-481e-4dd4-83da-583e219a907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:24.812430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0136d706-481e-4dd4-83da-583e219a907e None None] MFA Rules not processed for user `fd4f6fe3d8264a39aab48a096d11ad7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:24.813762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0136d706-481e-4dd4-83da-583e219a907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:24.832636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:24.898021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 843/1677] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:24.899102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:24.905415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:25.021793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 835/1678] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:25.023036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136d706-481e-4dd4-83da-583e219a907e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.058497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136d706-481e-4dd4-83da-583e219a907e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.077710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.078882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.079546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.079975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.080920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:25.081368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.083467 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.095007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac641325-94fd-46b2-ad45-0be6108224f0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.108724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 836/1679] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:25.110108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.118457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:25.125968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.127126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.127367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.127684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.190233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.194751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.240487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 844/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:25.241952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.246890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2408cb9-32de-42e9-af28-1b3bc9f14e69 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.256134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097837c7-5a0e-4f07-845e-7ac7fb2df477 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.260011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.260990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.261451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.263345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.263454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71050a3-b72d-4e92-8af7-9f95430c6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.264079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71050a3-b72d-4e92-8af7-9f95430c6f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.264856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71050a3-b72d-4e92-8af7-9f95430c6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.264856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71050a3-b72d-4e92-8af7-9f95430c6f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.265745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71050a3-b72d-4e92-8af7-9f95430c6f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.267830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71050a3-b72d-4e92-8af7-9f95430c6f02 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.296396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.301114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.322278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 845/1681] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:25 2022] POST /identity/v3/projects => generated 357 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:25.330230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 837/1682] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:25.331994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973229de-185b-4520-9423-72c979470474 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.332284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973229de-185b-4520-9423-72c979470474 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.332603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973229de-185b-4520-9423-72c979470474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.333446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.368768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c7402-8f40-424b-8484-cdf0064516e4 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.410625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-973229de-185b-4520-9423-72c979470474 None None] MFA Rules not processed for user `e50d226291da44b5a2c35f79726ff3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:25.412745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-973229de-185b-4520-9423-72c979470474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:25.423234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:25.548179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.560701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.561027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.563273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.569610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.576188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.588290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 846/1683] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:25.589676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973229de-185b-4520-9423-72c979470474 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.667285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 838/1684] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:25 2022] POST /identity/v3/users => generated 279 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:25.668465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.672006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:25.704059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:25.713585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973229de-185b-4520-9423-72c979470474 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.724828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.725824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.726222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.726577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.728578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:25.832537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.834749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.836551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ee94-8951-4f52-ba72-84c991e384c4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.844265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.848996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.849468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.849909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.853187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 847/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:25.854398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.881936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.884381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.888011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77581db1-ad76-49f9-8373-6cb6f213c38f service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.902175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.904150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:25.904515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:25.904871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:25.906482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:25.911982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:25.938569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 848/1686] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:25.941689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.943577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 839/1687] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:25.944963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:25.946608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:25.990274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e596593-d754-4e71-8a6c-096bd975f747 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:25.997572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:25.999761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.000622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ba9bf-ba4c-4a3e-abf6-837a74ec69a1 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:26.002155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.003429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] PATH_INFO: `/v3/projects/3e466fc6b98d46e4a91e40ff65f5f7ef` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.007352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e466fc6b98d46e4a91e40ff65f5f7ef)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:26.015881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:26.017376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.017813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:26.018388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.020085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.021231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:26.028093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:26.066352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 840/1688] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:26.070729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:26.103690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdd55-5418-437e-ba77-307094c69fa5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:26.117743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:26.118667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.118949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.119223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] PATH_INFO: `/v3/projects/baae7c7895d549cbaf23e7c0890bd80b/users/35548047cda94b2bab4809f0c3718310/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.153369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e466fc6b98d46e4a91e40ff65f5f7ef', 'request_id': 'req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.160905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baae7c7895d549cbaf23e7c0890bd80b, user_id=35548047cda94b2bab4809f0c3718310, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:26.166495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:26.172677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e466fc6b98d46e4a91e40ff65f5f7ef', 'request_id': 'req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.198428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e466fc6b98d46e4a91e40ff65f5f7ef', 'request_id': 'req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.199585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 841/1689] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:26 2022] PUT /identity/v3/projects/baae7c7895d549cbaf23e7c0890bd80b/users/35548047cda94b2bab4809f0c3718310/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:26.210523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] The token cache is being invalidate because project 3e466fc6b98d46e4a91e40ff65f5f7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:26.210980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.211656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:26.211762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fb0c844a-2a8d-4ef1-a168-aaf8357932b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.214035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 849/1690] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:25 2022] DELETE /identity/v3/projects/3e466fc6b98d46e4a91e40ff65f5f7ef => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:26.215526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9e8c-58a1-410a-8bc2-f5dd309dded0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.216280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9e8c-58a1-410a-8bc2-f5dd309dded0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.216626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9e8c-58a1-410a-8bc2-f5dd309dded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.219254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.288781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c1ca9e8c-58a1-410a-8bc2-f5dd309dded0 None None] MFA Rules not processed for user `35548047cda94b2bab4809f0c3718310`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:26.291196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c1ca9e8c-58a1-410a-8bc2-f5dd309dded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.391219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867043d-eb25-4856-8c6d-8347993cf598 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:26.404099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:26.405200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.405285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.405541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] PATH_INFO: `/v3/projects/b7882d882aa04d77b94acf8c2e3b73a2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.406815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7882d882aa04d77b94acf8c2e3b73a2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:26.408799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:26.419522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:26.500770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7882d882aa04d77b94acf8c2e3b73a2', 'request_id': 'req-fd2c6558-185f-40f0-a198-f0d36e07ed48'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.504959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 850/1691] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:26.504959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b549fb-2731-493e-a46c-572f12dbba5b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.504959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b549fb-2731-493e-a46c-572f12dbba5b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.506471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b549fb-2731-493e-a46c-572f12dbba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.515135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7882d882aa04d77b94acf8c2e3b73a2', 'request_id': 'req-fd2c6558-185f-40f0-a198-f0d36e07ed48'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.529874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7882d882aa04d77b94acf8c2e3b73a2', 'request_id': 'req-fd2c6558-185f-40f0-a198-f0d36e07ed48'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.537502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:26.552538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] The token cache is being invalidate because project b7882d882aa04d77b94acf8c2e3b73a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:26.552942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.554676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:26.565635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 842/1692] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:26 2022] DELETE /identity/v3/projects/b7882d882aa04d77b94acf8c2e3b73a2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:26.565635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:26.566100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a2b549fb-2731-493e-a46c-572f12dbba5b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:26.566386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a2b549fb-2731-493e-a46c-572f12dbba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.569722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.720623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6558-185f-40f0-a198-f0d36e07ed48 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:26.722974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 851/1693] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:26.724392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65e8fa-45a9-495e-8a49-0fdccb56d3b6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.724682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65e8fa-45a9-495e-8a49-0fdccb56d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.724956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65e8fa-45a9-495e-8a49-0fdccb56d3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.737683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d4146-142f-4e61-81e1-83d6d4695ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:26.742349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4146-142f-4e61-81e1-83d6d4695ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.742816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4146-142f-4e61-81e1-83d6d4695ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.743271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4146-142f-4e61-81e1-83d6d4695ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.744132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4146-142f-4e61-81e1-83d6d4695ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:26.747287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4146-142f-4e61-81e1-83d6d4695ef0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:26.761582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6c65e8fa-45a9-495e-8a49-0fdccb56d3b6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:26.762824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c65e8fa-45a9-495e-8a49-0fdccb56d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.786695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 852/1694] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:26.788391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.790442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.791501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.796483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 843/1695] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/projects => generated 357 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:26.798108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.798554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.798966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.826143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:26.827667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.838806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:26.840410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:26.938407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 844/1696] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:26.939825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:26.956297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f29ae-cdcb-4e33-b880-c6201eeb285c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:26.971082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:26.973592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:26.978466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:26.978466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:26.978466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:26.978466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:26.979257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 853/1697] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:26.981117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:26.997992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf90a0-a4c5-4005-a253-9c668e5969c7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.008072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.011509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.011779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:27.013434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.014086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.017830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:27.018456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.020566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 845/1698] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:26 2022] POST /identity/v3/users => generated 285 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:27.023630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.023844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.052410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 854/1699] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:27.053432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.055735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9a79-7e16-453c-a18a-8e5f883f2b49 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.065944 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.066688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.066973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.067263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.068006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:27.068320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.069994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.071316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b083f88-6f3a-4faa-9a20-0e6644599301 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.084378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.085175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.085559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.085954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.086816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.088526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.089469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 846/1700] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:27.090405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.101306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a39fc-e79e-4577-9322-7df05821b3d2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.107709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.108444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.108734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.109019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.110089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.112082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.113537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 855/1701] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:27.114505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.145977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ecee1-70ed-4a74-b545-30701dca8d6a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.152784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.153660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.154783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.155147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.155448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 847/1702] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:27 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:27.156677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.157369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.161400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.218165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 856/1703] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:27 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:27.218165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.255239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee1ea-11d0-41b7-8ee2-efc68fd266b6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.350939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:27.379098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ca21-eb7f-40e9-9e60-ae46ded86542 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.392804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.395331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.395734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.396195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.397015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.401564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.405869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.406811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.407102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.407386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] PATH_INFO: `/v3/projects/4f6c6a93a75642abb1a579e991e67c00/users/19441af5b3be48a2960a42168fb48172/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.449002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 857/1704] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:27 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:27.449002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.455980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6c6a93a75642abb1a579e991e67c00, user_id=19441af5b3be48a2960a42168fb48172, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.462216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.471519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf292e8-5a50-4962-974b-40a2b733c8c5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.489501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.490561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.494339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 848/1705] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:27 2022] PUT /identity/v3/projects/4f6c6a93a75642abb1a579e991e67c00/users/19441af5b3be48a2960a42168fb48172/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:27.494512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.494512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.494512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.495256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.499001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.547543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 858/1706] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:27 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:27.552402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.579829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6b050-8865-4651-b711-2dcec7f35ed8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.601154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:27.608884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a912-92e3-40f0-ba2c-95b61fc40449 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.616281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.617166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.617550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.618005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.618848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.620619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.636303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 849/1707] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:27.636303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.647711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df864a-c684-44f1-a9df-daf0deac9dd0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.667092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.667894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.668278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.668644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.669511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.672139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.696365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 850/1708] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:27.700924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.710514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.711488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.711878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.712342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.713341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.715454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.719829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df63f30-5f43-48e2-8f2c-dee45014d678 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.733372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 859/1709] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:27.733372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.733672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.733997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.734629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.734914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.735656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.737427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.748850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525101f-733c-4d8b-8ceb-998c3f69168a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.757461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.758856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.759520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.759911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.761226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.766854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 851/1710] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:27.766854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.772406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.786677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec740-be81-40a5-96fa-5677515f1907 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.794298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 860/1711] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:27.796300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.797673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.799034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.799034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.799186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] PATH_INFO: `/v3/projects/4f6c6a93a75642abb1a579e991e67c00/users/19441af5b3be48a2960a42168fb48172/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.805055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6c6a93a75642abb1a579e991e67c00, user_id=19441af5b3be48a2960a42168fb48172, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.811184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.818131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04813-ffb7-4974-a433-f2a9ea14d89f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:27.831430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0b1bc-6fda-45e4-b859-ce10b2f02339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:27.832503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0b1bc-6fda-45e4-b859-ce10b2f02339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.832795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0b1bc-6fda-45e4-b859-ce10b2f02339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.833081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0b1bc-6fda-45e4-b859-ce10b2f02339 admin admin] PATH_INFO: `/v3/projects/a2f0ac4a951b473aaa137f7192374e50/users/3d9c98c954be4ff1b2c97fcd0a5a313e/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.843241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 852/1712] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:27 2022] PUT /identity/v3/projects/4f6c6a93a75642abb1a579e991e67c00/users/19441af5b3be48a2960a42168fb48172/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:27.844286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:27.859763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0b1bc-6fda-45e4-b859-ce10b2f02339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f0ac4a951b473aaa137f7192374e50, user_id=3d9c98c954be4ff1b2c97fcd0a5a313e, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:27.863585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0b1bc-6fda-45e4-b859-ce10b2f02339 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:27.890856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 861/1713] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:27 2022] PUT /identity/v3/projects/a2f0ac4a951b473aaa137f7192374e50/users/3d9c98c954be4ff1b2c97fcd0a5a313e/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:27.899482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70dc9c-dd75-4230-bb27-7d5537fa0077 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:27.899482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70dc9c-dd75-4230-bb27-7d5537fa0077 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:27.899482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70dc9c-dd75-4230-bb27-7d5537fa0077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:27.938461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8d70dc9c-dd75-4230-bb27-7d5537fa0077 None None] MFA Rules not processed for user `19441af5b3be48a2960a42168fb48172`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:27.939779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8d70dc9c-dd75-4230-bb27-7d5537fa0077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:27.945917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c01f-32ff-42b0-b134-a07ddeeb67b1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:28.053953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 862/1714] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:28.055523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe54095-ee75-4d46-a9f3-c53a6636d5c6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.056215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe54095-ee75-4d46-a9f3-c53a6636d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.056533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe54095-ee75-4d46-a9f3-c53a6636d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.057756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:28.059986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.061067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.062809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] PATH_INFO: `/v3/projects/8f8a244014b64341bb08c170dd8b8b41/users/e268070825de48828ca0adc7bb5658ed/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.085939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:28.098320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7fe54095-ee75-4d46-a9f3-c53a6636d5c6 None None] MFA Rules not processed for user `3d9c98c954be4ff1b2c97fcd0a5a313e`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:28.100474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7fe54095-ee75-4d46-a9f3-c53a6636d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:28.105520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8a244014b64341bb08c170dd8b8b41, user_id=e268070825de48828ca0adc7bb5658ed, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:28.108160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:28.131768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 853/1715] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:27 2022] PUT /identity/v3/projects/8f8a244014b64341bb08c170dd8b8b41/users/e268070825de48828ca0adc7bb5658ed/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:28.132572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:28.137240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:28.213268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 863/1716] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:28.215515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.215817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.216101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.256305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] MFA Rules not processed for user `e268070825de48828ca0adc7bb5658ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:28.261714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:28.285876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:28.298072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0da45a-fd60-49f1-9020-9044af5adf76 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:28.310969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:28.312951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.313376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.315243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.394142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 864/1717] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:28.395158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:28.397862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:28.504740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:28.508731 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:28.537242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 854/1718] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:28.538278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:28.616078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd9e8f-6e9e-4e9a-bf6b-e80fdb5f6288 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:28.634713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dac1c3-f4fe-4d6c-8f44-498233aeb812 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:28.634931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:28.636170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.638445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.638800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.641253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:28.642175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.642531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.642970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.644543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:28.646818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:28.705202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 855/1719] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:28 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:28.707921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:28.777896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:28.829100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d156-dcc9-4259-84da-26933edb7f02 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:28.836094 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:28.837293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.837895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.838341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.839334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:28.842366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:28.870314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:28.872094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:28.895278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 856/1720] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:28 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:28.896517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:28.915950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 865/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:28.917056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:28.948266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:28.956069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99d577-9378-4021-92f1-dc3021f972f2 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:28.969654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:28.970463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:28.970846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:28.971319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:28.972538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:28.975201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:29.008393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 866/1722] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:29.009583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:29.027997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a87f7-b795-4903-88ee-c6a98d86f89f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.046377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:29.047404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.047758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.048102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] PATH_INFO: `/v3/projects/3bfb00f0d1394b0aa6a98566a28c9cf5/users/aff6503a72bf4f509df7267c436a8a9e/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.078037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfb00f0d1394b0aa6a98566a28c9cf5, user_id=aff6503a72bf4f509df7267c436a8a9e, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:29.080560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:29.081745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cccda-b786-4e4b-8c16-1f89bcb3caaa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.088302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:29.089795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.090460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.090900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.093562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:29.110528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 867/1723] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:29 2022] PUT /identity/v3/projects/3bfb00f0d1394b0aa6a98566a28c9cf5/users/aff6503a72bf4f509df7267c436a8a9e/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:29.113828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:29.261762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:29.262781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1ced8-8cd1-4f47-a843-2972298c6c4f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.263244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:29.278602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:29.279299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.279584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.279965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.280597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:29.282255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:29.306559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 868/1724] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:56:29.307455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:29.314373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 857/1725] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:29.315658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:29.338417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48355a37-b243-425c-97be-0f6e7f43962c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.353033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25c86f-80ac-4a55-962d-5188ee0a4779 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.355863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:29.356814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.357034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.363739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] PATH_INFO: `/v3/users/3d9c98c954be4ff1b2c97fcd0a5a313e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.368952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9c98c954be4ff1b2c97fcd0a5a313e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:29.377457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7c915-7f7e-4c8c-a818-570d4814a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:29.378416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c915-7f7e-4c8c-a818-570d4814a5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.378701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c915-7f7e-4c8c-a818-570d4814a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.378977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c915-7f7e-4c8c-a818-570d4814a5ef admin admin] PATH_INFO: `/v3/projects/3bfb00f0d1394b0aa6a98566a28c9cf5/users/aff6503a72bf4f509df7267c436a8a9e/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.380269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:29.388985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7c915-7f7e-4c8c-a818-570d4814a5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfb00f0d1394b0aa6a98566a28c9cf5, user_id=aff6503a72bf4f509df7267c436a8a9e, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:29.391718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7c915-7f7e-4c8c-a818-570d4814a5ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:29.420409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 858/1726] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:29 2022] PUT /identity/v3/projects/3bfb00f0d1394b0aa6a98566a28c9cf5/users/aff6503a72bf4f509df7267c436a8a9e/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:29.432721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270af33e-3f26-4356-985c-d5951640c84b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.433006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270af33e-3f26-4356-985c-d5951640c84b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.433282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270af33e-3f26-4356-985c-d5951640c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.511157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9c98c954be4ff1b2c97fcd0a5a313e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:29.528407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9c98c954be4ff1b2c97fcd0a5a313e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:29.542879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-270af33e-3f26-4356-985c-d5951640c84b None None] MFA Rules not processed for user `aff6503a72bf4f509df7267c436a8a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:29.546518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-270af33e-3f26-4356-985c-d5951640c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:29.566259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9c98c954be4ff1b2c97fcd0a5a313e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:29.568325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9c98c954be4ff1b2c97fcd0a5a313e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:29.616241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e5376bb-c9fa-48b6-98cb-f184744f66c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9c98c954be4ff1b2c97fcd0a5a313e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:29.625593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:29.638413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 869/1727] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:29 2022] DELETE /identity/v3/users/3d9c98c954be4ff1b2c97fcd0a5a313e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:29.641641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.642607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.642992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.715788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:29.722226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:29.762442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 859/1728] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:29.787046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270af33e-3f26-4356-985c-d5951640c84b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:29.789009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-270af33e-3f26-4356-985c-d5951640c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:29.829622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 870/1729] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:29.841003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:29.842471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:29.898023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:29.930115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee293a9-4b44-4acd-a730-0f1477d5be31 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.934392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e7ebc-2816-4373-b0b8-e2e8ebb85230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:29.937252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7ebc-2816-4373-b0b8-e2e8ebb85230 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:29.937861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7ebc-2816-4373-b0b8-e2e8ebb85230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:29.938162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7ebc-2816-4373-b0b8-e2e8ebb85230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:29.942049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270af33e-3f26-4356-985c-d5951640c84b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:29.970265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e7ebc-2816-4373-b0b8-e2e8ebb85230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:29.977442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e7ebc-2816-4373-b0b8-e2e8ebb85230 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:30.017445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 871/1730] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:56:30.119275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:30.120204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:30.121777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:30.122186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:30.269895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e94434-49b4-4138-b3e7-73059daa981c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:30.270191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e94434-49b4-4138-b3e7-73059daa981c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:30.270468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e94434-49b4-4138-b3e7-73059daa981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:30.306941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c1e94434-49b4-4138-b3e7-73059daa981c None None] MFA Rules not processed for user `e50d226291da44b5a2c35f79726ff3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:30.310512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c1e94434-49b4-4138-b3e7-73059daa981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:30.326188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:30.330575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:30.358162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 860/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:30.528165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 872/1732] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:31.793402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:31.795629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:31.843143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b74d5-46e0-4f86-b462-9f7d464e26ff service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:31.879117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:31.880349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:31.880857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:31.891239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] PATH_INFO: `/v3/users/e268070825de48828ca0adc7bb5658ed` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:31.893457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e268070825de48828ca0adc7bb5658ed)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:31.895781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:32.054969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e268070825de48828ca0adc7bb5658ed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:32.074222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e268070825de48828ca0adc7bb5658ed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:32.075139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e268070825de48828ca0adc7bb5658ed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:32.097378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e268070825de48828ca0adc7bb5658ed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:32.098565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e268070825de48828ca0adc7bb5658ed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:32.150932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 861/1733] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:31 2022] DELETE /identity/v3/users/e268070825de48828ca0adc7bb5658ed => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:32.156177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c762d-3c59-4dc8-b66a-200f0f2b55ff None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:32.156738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c762d-3c59-4dc8-b66a-200f0f2b55ff None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:32.156908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c762d-3c59-4dc8-b66a-200f0f2b55ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:32.186266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3d9c762d-3c59-4dc8-b66a-200f0f2b55ff None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:32.187906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3d9c762d-3c59-4dc8-b66a-200f0f2b55ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:32.305085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:32.336668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 873/1734] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:32.359823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:32.362713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:32.395212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:32.498834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdd094-b535-4551-8efc-566e89b96fd3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:32.507465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97371b6d-fc81-440a-a12e-8ee827e60127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:32.515649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371b6d-fc81-440a-a12e-8ee827e60127 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:32.515949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371b6d-fc81-440a-a12e-8ee827e60127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:32.516430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97371b6d-fc81-440a-a12e-8ee827e60127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:32.551812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371b6d-fc81-440a-a12e-8ee827e60127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:32.553577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97371b6d-fc81-440a-a12e-8ee827e60127 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:32.601035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 862/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:32.614799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51f7c-d010-42a7-929a-0b3591d107b5 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:32.615278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51f7c-d010-42a7-929a-0b3591d107b5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:32.615941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51f7c-d010-42a7-929a-0b3591d107b5 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:32.636112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 874/1736] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 23 11:56:32 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:32.643199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:32.644409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:32.646520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:32.665965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51f7c-d010-42a7-929a-0b3591d107b5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:32.667939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-48d51f7c-d010-42a7-929a-0b3591d107b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:32.746423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51f7c-d010-42a7-929a-0b3591d107b5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:32.762761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:32.766887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:32.768342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:32.768858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:32.769153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] PATH_INFO: `/v3/projects/a2f0ac4a951b473aaa137f7192374e50` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:32.771792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:32.772448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f0ac4a951b473aaa137f7192374e50)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:32.779024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:32.799495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 863/1737] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:56:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:32.921762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:32.926789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:32.958535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3c61a-834c-4a78-a4d5-baae1ccfdc55 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:32.986787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f0ac4a951b473aaa137f7192374e50', 'request_id': 'req-1be2f5c2-3a6b-4026-a8fd-89130b02f763'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.003332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f0ac4a951b473aaa137f7192374e50', 'request_id': 'req-1be2f5c2-3a6b-4026-a8fd-89130b02f763'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.022841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f0ac4a951b473aaa137f7192374e50', 'request_id': 'req-1be2f5c2-3a6b-4026-a8fd-89130b02f763'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.051108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] The token cache is being invalidate because project a2f0ac4a951b473aaa137f7192374e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:33.051512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.054041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1be2f5c2-3a6b-4026-a8fd-89130b02f763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.058954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 875/1738] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:32 2022] DELETE /identity/v3/projects/a2f0ac4a951b473aaa137f7192374e50 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:33.061251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.061569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.061904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.105662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:33.107108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:33.172872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:33.179587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.179886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.180177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.192278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:33.229231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:33.230758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bf67e-05e5-4ff8-84be-7a0596a5a7fc service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:33.277480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 864/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:33.421163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.421469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.421825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 876/1740] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:33.422270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.486378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:33.498276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:33.534153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 865/1741] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:33.538093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:33.552269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18a735-6637-4ae2-b07d-7785491713e7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:33.552878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:33.554418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:33.572162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:33.574974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.575270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.575557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.581069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:33.581396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:33.582622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04c94f-ba42-4276-a8ec-35f15f64acf2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:33.591915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:33.604720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:33.605675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.605969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.606249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] PATH_INFO: `/v3/users/52a87762ec634c8ab4ec9b1dbbfb5e50` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.607628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a87762ec634c8ab4ec9b1dbbfb5e50)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:33.609942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:33.636160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 877/1742] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:33.637844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:33.665700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6ca1-d2e7-4457-bc8e-2fc0f08b3c1f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:33.680626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:33.682609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.685016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.685391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.686345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:33.691676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:33.702174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a87762ec634c8ab4ec9b1dbbfb5e50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.718905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a87762ec634c8ab4ec9b1dbbfb5e50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.719438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a87762ec634c8ab4ec9b1dbbfb5e50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.728217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a87762ec634c8ab4ec9b1dbbfb5e50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.729550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daa9938f-0e12-4ad7-aa64-68f28736fbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a87762ec634c8ab4ec9b1dbbfb5e50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:33.775530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 866/1743] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:33 2022] DELETE /identity/v3/users/52a87762ec634c8ab4ec9b1dbbfb5e50 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:33.775777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 878/1744] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:33 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:33.778812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.779303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.779591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.779988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:33.782351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:33.822998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:33.833126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:33.836208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:33.858422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:33.914383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608513-229e-4965-a3d7-e6ed9ea9316e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:33.941731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:33.941731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:33.941731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:33.941731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:33.942097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:33.942097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:33.991457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 879/1745] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:33 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:33.995952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.016206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc0ab-1314-49ae-9169-55d8f993bb99 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:34.020946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 867/1746] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:34.033591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:34.034729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.035122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.035475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.036311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:34.039161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:34.063061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 880/1747] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:34.066104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.081926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d7d1-8079-452e-bda1-3ee962a00e52 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:34.091809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:34.092547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.092797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.094601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.096443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:34.102205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.104284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:34.105905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:34.139905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 868/1748] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:34.140832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.169416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfda6f-f1f9-42ec-9e65-441850d9f6d4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:34.175734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834f64-16f3-4987-902d-ccca8da03bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:34.176651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834f64-16f3-4987-902d-ccca8da03bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.177074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834f64-16f3-4987-902d-ccca8da03bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.177359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834f64-16f3-4987-902d-ccca8da03bbe admin admin] PATH_INFO: `/v3/projects/3d2e7f50c4ab40a991b2cdf05a8bfa71/users/b27e46f966ef4b88a4fa183010b4339d/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.200325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834f64-16f3-4987-902d-ccca8da03bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2e7f50c4ab40a991b2cdf05a8bfa71, user_id=b27e46f966ef4b88a4fa183010b4339d, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:34.204120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834f64-16f3-4987-902d-ccca8da03bbe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:34.239546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19055c6b-2f1d-44e9-b803-3cb90cbb6512 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:34.255909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 869/1749] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:34 2022] PUT /identity/v3/projects/3d2e7f50c4ab40a991b2cdf05a8bfa71/users/b27e46f966ef4b88a4fa183010b4339d/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:34.258782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbb0e7-3796-4d40-8e21-1ff035d61b91 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.259891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbb0e7-3796-4d40-8e21-1ff035d61b91 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.260383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbb0e7-3796-4d40-8e21-1ff035d61b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.349101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-06bbb0e7-3796-4d40-8e21-1ff035d61b91 None None] MFA Rules not processed for user `b27e46f966ef4b88a4fa183010b4339d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:34.353415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fbef6-e214-4176-be51-eb86090396ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:34.354319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fbef6-e214-4176-be51-eb86090396ac service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.354608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fbef6-e214-4176-be51-eb86090396ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.355273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fbef6-e214-4176-be51-eb86090396ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.377081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-06bbb0e7-3796-4d40-8e21-1ff035d61b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:34.497274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 870/1750] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:34.500412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476978-afa9-4bdb-beb1-e54fbfcd76f2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.501014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476978-afa9-4bdb-beb1-e54fbfcd76f2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.501434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476978-afa9-4bdb-beb1-e54fbfcd76f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.541925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c5476978-afa9-4bdb-beb1-e54fbfcd76f2 None None] MFA Rules not processed for user `cdc4a7650e904ba990d9ced0fda14bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:34.543604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c5476978-afa9-4bdb-beb1-e54fbfcd76f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:34.598648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fbef6-e214-4176-be51-eb86090396ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:34.604768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fbef6-e214-4176-be51-eb86090396ac service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:34.628436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 881/1751] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:34.630632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10180c5-a47d-4701-be71-00fa2e0185be None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.630928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10180c5-a47d-4701-be71-00fa2e0185be None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.631230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10180c5-a47d-4701-be71-00fa2e0185be None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.638928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 882/1752] 10.222.0.27 () {54 vars in 960 bytes} [Thu Jun 23 11:56:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:34.640132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10180c5-a47d-4701-be71-00fa2e0185be None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.656217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10180c5-a47d-4701-be71-00fa2e0185be None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:34.658781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:34.665943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeedfd-69f5-4902-a967-5d36fdca4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:34.666869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeedfd-69f5-4902-a967-5d36fdca4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.667163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeedfd-69f5-4902-a967-5d36fdca4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.667449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeedfd-69f5-4902-a967-5d36fdca4d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.668259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeedfd-69f5-4902-a967-5d36fdca4d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:34.671514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeedfd-69f5-4902-a967-5d36fdca4d03 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:34.700712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:34.717747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 871/1753] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:34.717747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.720053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 883/1754] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:34 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:34.720053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:34.720591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.720878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.721945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:34.722529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:34.769055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:34.770676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] MFA Rules not processed for user `761bdea435cf43f98b28b371723f9478`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:34.773222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:34.780219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:34.957869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 872/1755] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:34.959147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.981249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 884/1756] 10.222.0.27 () {58 vars in 1057 bytes} [Thu Jun 23 11:56:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:34.982433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:34.984140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.068008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e86c-fd6f-4c03-a08f-5a229e05adb9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:35.080667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:35.081681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.082154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.082520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.084383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:35.087444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:35.123225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 873/1757] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:34 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:35.124167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:35.128484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.150990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8c1c1-6c9d-4d06-a848-940ef69e8cf7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:35.169451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856d787-c764-4a45-9c75-89f6a8e4bd1c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:35.169898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b0d9-f7ba-4d37-a4ff-ec9ae0764844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:35.171178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b0d9-f7ba-4d37-a4ff-ec9ae0764844 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.172609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b0d9-f7ba-4d37-a4ff-ec9ae0764844 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.173433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b0d9-f7ba-4d37-a4ff-ec9ae0764844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.184187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:35.185084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.185381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.185793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] PATH_INFO: `/v3/projects/8f8a244014b64341bb08c170dd8b8b41` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.188634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8a244014b64341bb08c170dd8b8b41)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:35.192930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:35.290125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739b0d9-f7ba-4d37-a4ff-ec9ae0764844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:35.293734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739b0d9-f7ba-4d37-a4ff-ec9ae0764844 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:35.316398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 885/1758] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:35.317813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.318301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.318587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.360134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] MFA Rules not processed for user `761bdea435cf43f98b28b371723f9478`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:35.361681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.407902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8a244014b64341bb08c170dd8b8b41', 'request_id': 'req-0a91255a-f98c-46ed-8b6d-327bff316c20'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:35.422152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:35.426627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8a244014b64341bb08c170dd8b8b41', 'request_id': 'req-0a91255a-f98c-46ed-8b6d-327bff316c20'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:35.444433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8a244014b64341bb08c170dd8b8b41', 'request_id': 'req-0a91255a-f98c-46ed-8b6d-327bff316c20'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:35.453402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:35.477684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] The token cache is being invalidate because project 8f8a244014b64341bb08c170dd8b8b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:35.477684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:35.479278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:35.481229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 874/1759] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:35 2022] DELETE /identity/v3/projects/8f8a244014b64341bb08c170dd8b8b41 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:35.482387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:35.483856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.492918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 886/1760] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:35.492918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:35.505105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.710371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140626-30e4-417b-a6f3-c446b2c7a685 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:35.725732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:35.729638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.730161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.730453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.740509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:35.740509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:35.771109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 887/1761] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:35.772482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:35.774484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.797475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0179ca2-e4fd-46d5-89dd-0fcc2e531444 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:35.798747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91255a-f98c-46ed-8b6d-327bff316c20 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:35.804868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:35.805960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.806385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.806856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] PATH_INFO: `/v3/users/aff6503a72bf4f509df7267c436a8a9e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.808935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff6503a72bf4f509df7267c436a8a9e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:35.810721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:35.817075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:35.819326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:35.820098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:35.820377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:35.828115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.898321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:35.905820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:35.935125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 875/1762] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:35.936630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:35.947226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:35.968381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff6503a72bf4f509df7267c436a8a9e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:35.987346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff6503a72bf4f509df7267c436a8a9e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:36.004909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff6503a72bf4f509df7267c436a8a9e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:36.007189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff6503a72bf4f509df7267c436a8a9e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:36.033638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff6503a72bf4f509df7267c436a8a9e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:36.046103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 888/1763] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:35 2022] DELETE /identity/v3/users/aff6503a72bf4f509df7267c436a8a9e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:36.047035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:36.050390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:36.128857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030dc68-9054-46f6-bcb8-cebb1c430d07 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:36.147085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:36.170558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1217d2-1fc8-4c32-bef4-ca1965e00a0b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:36.176794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:36.177767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.178188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.178470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] PATH_INFO: `/v3/projects/1ae6bf3c2c164e54b4ab0156a4200c5d/users/ff45e0c9d0ff4044b31437d890f300be/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:36.197810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae6bf3c2c164e54b4ab0156a4200c5d, user_id=ff45e0c9d0ff4044b31437d890f300be, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:36.201588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:36.220973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 889/1764] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:36 2022] PUT /identity/v3/projects/1ae6bf3c2c164e54b4ab0156a4200c5d/users/ff45e0c9d0ff4044b31437d890f300be/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:36.227068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:36.305428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:36.306205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.306518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.306764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:36.308892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:36.336184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:36.345720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0ac4f-2af8-4bd1-9488-9e09e67be99b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:36.361344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:36.362448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.364185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.364579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:36.367990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:36.372779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:36.406759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 890/1765] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:36.411275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:36.438011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7156-4445-4ae0-a93a-beaabf41e9f3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:36.449231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:36.456952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756513e-2dd1-423f-bea6-b557de6720e7 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:36.457891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dea28b-b074-4229-bf8a-7d9edf1a9f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:36.461311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dea28b-b074-4229-bf8a-7d9edf1a9f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.461941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dea28b-b074-4229-bf8a-7d9edf1a9f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.462997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dea28b-b074-4229-bf8a-7d9edf1a9f19 admin admin] PATH_INFO: `/v3/projects/1ae6bf3c2c164e54b4ab0156a4200c5d/users/ff45e0c9d0ff4044b31437d890f300be/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:36.469895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dea28b-b074-4229-bf8a-7d9edf1a9f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae6bf3c2c164e54b4ab0156a4200c5d, user_id=ff45e0c9d0ff4044b31437d890f300be, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:36.475389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dea28b-b074-4229-bf8a-7d9edf1a9f19 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:36.487949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 876/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:36.504496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 891/1767] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:36 2022] PUT /identity/v3/projects/1ae6bf3c2c164e54b4ab0156a4200c5d/users/ff45e0c9d0ff4044b31437d890f300be/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:36.515149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bab93-98c8-4dfd-b7fa-614c5cfc454c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.515457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bab93-98c8-4dfd-b7fa-614c5cfc454c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.515721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bab93-98c8-4dfd-b7fa-614c5cfc454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:36.553848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.555180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.557430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:36.633107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2d4bab93-98c8-4dfd-b7fa-614c5cfc454c None None] MFA Rules not processed for user `ff45e0c9d0ff4044b31437d890f300be`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:36.634563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] MFA Rules not processed for user `4705b076f9e34b1c92f0ac5e238c5292`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:36.635787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:36.635926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2d4bab93-98c8-4dfd-b7fa-614c5cfc454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:36.900932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 892/1768] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:36.906109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:36.910738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:36.953955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 877/1769] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:36.955617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:36.955968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:36.956254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.022286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] MFA Rules not processed for user `4705b076f9e34b1c92f0ac5e238c5292`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:37.030225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.059823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 878/1770] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:37.061079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:37.066748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.088015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:37.168441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252732-c258-47ff-b35e-fddc650731ea None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:37.185514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:37.186576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.186870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.187151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] PATH_INFO: `/v3/projects/4f83da30ae934ced83dad02264c3e9c2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.188411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f83da30ae934ced83dad02264c3e9c2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:37.191420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:37.276711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f83da30ae934ced83dad02264c3e9c2', 'request_id': 'req-7e739411-935c-4b71-a690-0d8dc9e43d52'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.289813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f83da30ae934ced83dad02264c3e9c2', 'request_id': 'req-7e739411-935c-4b71-a690-0d8dc9e43d52'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.299348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f83da30ae934ced83dad02264c3e9c2', 'request_id': 'req-7e739411-935c-4b71-a690-0d8dc9e43d52'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.305016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427088a-9bf6-4bbe-83d0-bb004b72d804 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:37.314415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] The token cache is being invalidate because project 4f83da30ae934ced83dad02264c3e9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:37.315123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.316362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7e739411-935c-4b71-a690-0d8dc9e43d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.322120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 893/1771] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:36 2022] DELETE /identity/v3/projects/4f83da30ae934ced83dad02264c3e9c2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:37.324972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f9ea-a32a-48b6-bfc1-bc5b6e15f641 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.324972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f9ea-a32a-48b6-bfc1-bc5b6e15f641 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.324972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5f9ea-a32a-48b6-bfc1-bc5b6e15f641 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.326901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 894/1772] 10.222.0.27 () {54 vars in 912 bytes} [Thu Jun 23 11:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:37.327677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5f9ea-a32a-48b6-bfc1-bc5b6e15f641 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:37.329579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6fb5f9ea-a32a-48b6-bfc1-bc5b6e15f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.420233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:37.421363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.421836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.422823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.425632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.434805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:37.466057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5f9ea-a32a-48b6-bfc1-bc5b6e15f641 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:37.478303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:37.480033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.480316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.480591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.485411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.522675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:37.524089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:37.537569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 879/1773] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:37.538741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:37.539993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.612357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:37.614080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:37.627904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 895/1774] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:37.629311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:37.631326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:37.644533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:37.650652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5638f-f915-452c-ae9a-492f603cfb41 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:37.661577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:37.662936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.663426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.663929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] PATH_INFO: `/v3/users/fd4f6fe3d8264a39aab48a096d11ad7b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.665839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4f6fe3d8264a39aab48a096d11ad7b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:37.668538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:37.809584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4f6fe3d8264a39aab48a096d11ad7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.834045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ffc8c-93a0-4bc7-b136-504acd741de7 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:37.837493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4f6fe3d8264a39aab48a096d11ad7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.838601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4f6fe3d8264a39aab48a096d11ad7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.841132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94942e7-8381-439e-b474-23272709902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:37.842339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94942e7-8381-439e-b474-23272709902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.842792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94942e7-8381-439e-b474-23272709902e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.843658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94942e7-8381-439e-b474-23272709902e admin admin] PATH_INFO: `/v3/projects/3bfb00f0d1394b0aa6a98566a28c9cf5` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.856365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4f6fe3d8264a39aab48a096d11ad7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.857189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb0ef77a-7ea3-4b44-b2f1-568addd43840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4f6fe3d8264a39aab48a096d11ad7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:37.861785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94942e7-8381-439e-b474-23272709902e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfb00f0d1394b0aa6a98566a28c9cf5)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:37.870338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94942e7-8381-439e-b474-23272709902e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:37.930196 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 880/1775] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:37 2022] DELETE /identity/v3/users/fd4f6fe3d8264a39aab48a096d11ad7b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:37.932637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:37.932931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:37.937889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:37.988899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:37.995165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:38.043394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f94942e7-8381-439e-b474-23272709902e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfb00f0d1394b0aa6a98566a28c9cf5', 'request_id': 'req-f94942e7-8381-439e-b474-23272709902e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.056139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:38.073398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f94942e7-8381-439e-b474-23272709902e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfb00f0d1394b0aa6a98566a28c9cf5', 'request_id': 'req-f94942e7-8381-439e-b474-23272709902e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.091953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f94942e7-8381-439e-b474-23272709902e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfb00f0d1394b0aa6a98566a28c9cf5', 'request_id': 'req-f94942e7-8381-439e-b474-23272709902e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.132590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f94942e7-8381-439e-b474-23272709902e admin admin] The token cache is being invalidate because project 3bfb00f0d1394b0aa6a98566a28c9cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:38.133276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f94942e7-8381-439e-b474-23272709902e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.137068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f94942e7-8381-439e-b474-23272709902e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.154250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 896/1776] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:37 2022] DELETE /identity/v3/projects/3bfb00f0d1394b0aa6a98566a28c9cf5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:38.159942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:38.160292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:38.162811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:38.197663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 881/1777] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:56:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:38.224501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:38.225986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:38.234943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:38.239382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:38.246167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ed25d-5ac7-41cc-a5e0-66de8af7f901 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:38.258990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa90d76-9caa-4ed7-b7e8-d629122031e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:38.260003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90d76-9caa-4ed7-b7e8-d629122031e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:38.260331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90d76-9caa-4ed7-b7e8-d629122031e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:38.260630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90d76-9caa-4ed7-b7e8-d629122031e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:38.280870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa90d76-9caa-4ed7-b7e8-d629122031e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:38.282682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa90d76-9caa-4ed7-b7e8-d629122031e6 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:38.318056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 882/1778] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:56:38.428444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 897/1779] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:38.436380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:38.437176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:38.437176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:38.578348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:38.579845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:38.604988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e658a6-f28f-4c9b-a86a-f4bb85ab97f6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:38.653791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:38.654727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:38.655040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:38.655324 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] PATH_INFO: `/v3/users/b27e46f966ef4b88a4fa183010b4339d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:38.668098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27e46f966ef4b88a4fa183010b4339d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:38.677663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:38.774728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:38.820122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27e46f966ef4b88a4fa183010b4339d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.835651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27e46f966ef4b88a4fa183010b4339d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.863505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27e46f966ef4b88a4fa183010b4339d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.864286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27e46f966ef4b88a4fa183010b4339d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.901056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:38.903387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:38.914025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8ab9dc92-012b-4918-a935-bec31aec6303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27e46f966ef4b88a4fa183010b4339d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:38.918491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 883/1780] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:38.922571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:38.933336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 898/1781] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:38 2022] DELETE /identity/v3/users/b27e46f966ef4b88a4fa183010b4339d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:38.938293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277373-1084-479d-8565-b796d21f1782 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:38.938293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277373-1084-479d-8565-b796d21f1782 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:38.938293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277373-1084-479d-8565-b796d21f1782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:38.947693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281332-e18f-4ace-adab-7f4c38fd7d58 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:38.987139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d9277373-1084-479d-8565-b796d21f1782 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:38.990564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d9277373-1084-479d-8565-b796d21f1782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.145123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.145856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.146314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.146726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.149532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:39.152534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.164375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:39.201531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 884/1782] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:56:39.202370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:39.211111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.240193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 899/1783] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:39.240775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de8ce0-4367-47cb-b198-57d5f82a2f44 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:39.242741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9277373-1084-479d-8565-b796d21f1782 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:39.257192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.258119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.258402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.258678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] PATH_INFO: `/v3/projects/fbf2423a183e4d22a1475d1261d4de2b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.260125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf2423a183e4d22a1475d1261d4de2b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.262383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:39.297874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9277373-1084-479d-8565-b796d21f1782 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:39.309342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047a65-269d-4284-869d-71db20d2d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.311177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047a65-269d-4284-869d-71db20d2d19e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.316676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047a65-269d-4284-869d-71db20d2d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.316676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047a65-269d-4284-869d-71db20d2d19e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.316676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a047a65-269d-4284-869d-71db20d2d19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.316676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a047a65-269d-4284-869d-71db20d2d19e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:39.376763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 900/1784] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:39 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:39.386044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.386486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.387097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.446091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:39.450296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.506941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf2423a183e4d22a1475d1261d4de2b', 'request_id': 'req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:39.531987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf2423a183e4d22a1475d1261d4de2b', 'request_id': 'req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:39.546742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf2423a183e4d22a1475d1261d4de2b', 'request_id': 'req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:39.577494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] The token cache is being invalidate because project fbf2423a183e4d22a1475d1261d4de2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:39.577829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:39.582186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:39.587828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 885/1785] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:39 2022] DELETE /identity/v3/projects/fbf2423a183e4d22a1475d1261d4de2b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:39.589445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:39.593476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.620286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 901/1786] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:39.622554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:39.625069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.712915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:39.767790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba648-0aba-4db0-b0ae-318490ba785f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:39.772788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf2f2-45fb-49ce-8ee2-ccff25ab9776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.773530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf2f2-45fb-49ce-8ee2-ccff25ab9776 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.773804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf2f2-45fb-49ce-8ee2-ccff25ab9776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.774135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf2f2-45fb-49ce-8ee2-ccff25ab9776 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.774790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf2f2-45fb-49ce-8ee2-ccff25ab9776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.778960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf2f2-45fb-49ce-8ee2-ccff25ab9776 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:39.792125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:39.827161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 902/1787] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:39 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:39.828774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.828898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.829238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.875602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:39.879445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.889577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 903/1788] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:39.890555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:39.902127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15238-1c5d-4041-ac99-cec2b44491f7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:39.907318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e94bf5-c17d-4d4c-bca0-51d4bafa8ae3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:39.909175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699bf53-7438-4ae2-8139-5803c169b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.909989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699bf53-7438-4ae2-8139-5803c169b861 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.910277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699bf53-7438-4ae2-8139-5803c169b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.910553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699bf53-7438-4ae2-8139-5803c169b861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.911999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699bf53-7438-4ae2-8139-5803c169b861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.913023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699bf53-7438-4ae2-8139-5803c169b861 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:39.931471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 904/1789] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:39.932771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.933063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.933440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.934660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.935346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.935631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.935911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.940708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.954513 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:39.957758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:39.969164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 905/1790] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:39.969164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:39.979349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b555f0-84b3-46a4-b84b-0eebf96f2e12 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:39.981555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.985533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:39.986221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:39.987031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:39.987386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:39.987728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:39.988565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:39.990486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:40.004430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 906/1791] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:40.008348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.020028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 886/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:40.020568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d1d7-ffbc-41a9-89ea-14a0b0404b9d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:40.025420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:40.026249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:40.026595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:40.026942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:40.027759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:40.027915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.028194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:40.033504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:40.033673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:40.048003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 907/1793] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:40.048853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.070232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b1d8-fbe5-42ed-adf7-673fcf1681c0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:40.075220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:40.076286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:40.076674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:40.077049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] PATH_INFO: `/v3/projects/759f811ec44646dca7eada2335381f0b/users/fceead239c1349758418b6a7b171bdcc/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:40.100026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=759f811ec44646dca7eada2335381f0b, user_id=fceead239c1349758418b6a7b171bdcc, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:40.105118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:40.130965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 908/1794] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:40 2022] PUT /identity/v3/projects/759f811ec44646dca7eada2335381f0b/users/fceead239c1349758418b6a7b171bdcc/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:40.142047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.270879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56f47-1347-4af8-b7f0-100e018658c6 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:40.324815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434ca9b-ff78-4b45-8933-6f971efe4dbe admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:40.344584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d398-8a53-404e-bde9-fa9a494049cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:40.345390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d398-8a53-404e-bde9-fa9a494049cb admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:40.345734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d398-8a53-404e-bde9-fa9a494049cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:40.346207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d398-8a53-404e-bde9-fa9a494049cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:40.346993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425d398-8a53-404e-bde9-fa9a494049cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:40.349021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425d398-8a53-404e-bde9-fa9a494049cb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:40.406084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 909/1795] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:40 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:40.407576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:40.408022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:40.408508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:40.438218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:40.438977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:40.439331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:40.439808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:40.472025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] MFA Rules not processed for user `fceead239c1349758418b6a7b171bdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:40.475852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:40.557913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:40.642168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:40.644466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:40.653902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 910/1796] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:40.653902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.688185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 887/1797] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:56:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:56:40.689938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.729199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8bc58-8693-46d3-bece-d756b51aa0e1 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:40.748715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:40.834203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:40.839036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:40.841934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:40.843129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:40.847083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:40.861119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:40.945976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 888/1798] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:40 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:40.949722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:40.955258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d4cd6-6a60-4c97-8adc-f7067ee147f6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.239488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffe179-2430-4b27-8b81-ec9394525cc1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.283186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:41.284356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:41.290066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:41.291110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:41.291971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:41.294250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:41.294921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:41.295210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:41.295494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:41.296177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:41.298190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:41.307838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:41.377962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 889/1799] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:40 2022] POST /identity/v3/users => generated 289 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:41.379228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:41.396496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 911/1800] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:40 2022] POST /identity/v3/users => generated 286 bytes in 745 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:41.400817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db0af-f106-4a55-8084-dccd63a23126 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.401331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:41.415919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:41.416963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:41.417395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:41.417861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:41.418769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:41.427516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:41.439627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2ecf1-4992-441f-9c03-a5f2cc4e9839 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.453072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 890/1801] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:41.458595 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:41.474822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:41.477755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:41.478322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:41.478780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:41.480437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bb296-cf5c-45ba-8a7a-091ba7412056 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.482405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:41.484193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:41.493171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:41.502145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:41.504457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:41.505099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] PATH_INFO: `/v3/projects/8054c80aa0f3428a8d1b1955b328a7fd/users/52e06b6e38e24579a666fb5caf4962b2/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:41.541244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 912/1802] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:41.542753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:41.573767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8054c80aa0f3428a8d1b1955b328a7fd, user_id=52e06b6e38e24579a666fb5caf4962b2, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:41.579582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d099a-c4b7-4fe6-ad05-6a3ab01f83d3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.580586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:41.614630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:41.617349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:41.617772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:41.618330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:41.627016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:41.628402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 891/1803] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:41 2022] PUT /identity/v3/projects/8054c80aa0f3428a8d1b1955b328a7fd/users/52e06b6e38e24579a666fb5caf4962b2/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:41.636952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:41.639106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:41.685724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 913/1804] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:41.687130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:41.723868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d721-ff89-4413-a3fa-04c79a708cf9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:41.915210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:42.014494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7e87f-795c-4090-8c5b-f6bc5de263b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:42.019209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e87f-795c-4090-8c5b-f6bc5de263b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:42.022096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e87f-795c-4090-8c5b-f6bc5de263b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:42.025097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7e87f-795c-4090-8c5b-f6bc5de263b2 admin admin] PATH_INFO: `/v3/projects/b09331503efc45f99ce2a0876f084f56/users/229327b6d6c8417ba3450a9c783f993b/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:42.092444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e87f-795c-4090-8c5b-f6bc5de263b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09331503efc45f99ce2a0876f084f56, user_id=229327b6d6c8417ba3450a9c783f993b, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:42.092984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:42.101889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7e87f-795c-4090-8c5b-f6bc5de263b2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:42.118057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2c754-007d-4d42-8ea7-4a3b427f2e1a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:42.146207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 914/1805] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:41 2022] PUT /identity/v3/projects/b09331503efc45f99ce2a0876f084f56/users/229327b6d6c8417ba3450a9c783f993b/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:42.150382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036714c-95b2-4b53-8cc7-a5409e91edef None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:42.150882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036714c-95b2-4b53-8cc7-a5409e91edef None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:42.151319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036714c-95b2-4b53-8cc7-a5409e91edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:42.211177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d036714c-95b2-4b53-8cc7-a5409e91edef None None] MFA Rules not processed for user `761bdea435cf43f98b28b371723f9478`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:42.219951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d036714c-95b2-4b53-8cc7-a5409e91edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:42.358451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76dbe6-d5bb-41c1-b820-83d8cd7a3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:42.359795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76dbe6-d5bb-41c1-b820-83d8cd7a3796 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:42.360807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76dbe6-d5bb-41c1-b820-83d8cd7a3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:42.361261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76dbe6-d5bb-41c1-b820-83d8cd7a3796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:42.362413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76dbe6-d5bb-41c1-b820-83d8cd7a3796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:42.367478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76dbe6-d5bb-41c1-b820-83d8cd7a3796 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:42.415185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 892/1806] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 779 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:42.417755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:42.418099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:42.418378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:42.464014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:42.467743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:42.512000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 893/1807] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:42.516050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:42.556057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6f086-32a7-4571-8b75-d6a3a849706b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:42.572573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:42.578260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:42.579109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:42.580217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] PATH_INFO: `/v3/projects/8054c80aa0f3428a8d1b1955b328a7fd/users/52e06b6e38e24579a666fb5caf4962b2/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:42.590842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8054c80aa0f3428a8d1b1955b328a7fd, user_id=52e06b6e38e24579a666fb5caf4962b2, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:42.603875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:42.607752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 915/1808] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:42.641588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769938-229f-4c1f-9e9e-14d12ac76b5f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:42.641821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769938-229f-4c1f-9e9e-14d12ac76b5f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:42.642258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769938-229f-4c1f-9e9e-14d12ac76b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:42.737638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 894/1809] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:42 2022] PUT /identity/v3/projects/8054c80aa0f3428a8d1b1955b328a7fd/users/52e06b6e38e24579a666fb5caf4962b2/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:42.737638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:42.751797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-54769938-229f-4c1f-9e9e-14d12ac76b5f None None] MFA Rules not processed for user `cdc4a7650e904ba990d9ced0fda14bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:42.756780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-54769938-229f-4c1f-9e9e-14d12ac76b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:43.246975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 916/1810] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:43.248338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7775340-b42b-4d5e-af66-640655924770 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:43.253013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936134-e615-4384-bdda-af867099af90 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:43.255001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936134-e615-4384-bdda-af867099af90 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:43.255523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936134-e615-4384-bdda-af867099af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:43.269076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c05931-24a6-4967-9e31-19cf187c65ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:43.271255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c05931-24a6-4967-9e31-19cf187c65ec service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:43.275893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c05931-24a6-4967-9e31-19cf187c65ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:43.279502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c05931-24a6-4967-9e31-19cf187c65ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:43.412088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-cf936134-e615-4384-bdda-af867099af90 None None] MFA Rules not processed for user `52e06b6e38e24579a666fb5caf4962b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:43.417358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cf936134-e615-4384-bdda-af867099af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:43.625134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c05931-24a6-4967-9e31-19cf187c65ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:43.628692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c05931-24a6-4967-9e31-19cf187c65ec service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:43.670640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 895/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 946 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:43.696729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:43.697070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:43.699180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:43.770847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:43.775023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:43.812891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:43.825324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 896/1812] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jun 23 11:56:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:43.825903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 917/1813] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 578 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:43.828816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:43.839779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:43.850161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936134-e615-4384-bdda-af867099af90 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:43.851595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cf936134-e615-4384-bdda-af867099af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:43.886482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30ba67-7512-4e9e-a646-1ec3f4072212 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:43.913226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:43.914507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:43.914960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:43.915382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] PATH_INFO: `/v3/projects/3d2e7f50c4ab40a991b2cdf05a8bfa71` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:43.917563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2e7f50c4ab40a991b2cdf05a8bfa71)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:43.926855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:43.987038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:44.135364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2e7f50c4ab40a991b2cdf05a8bfa71', 'request_id': 'req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:44.161541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2e7f50c4ab40a991b2cdf05a8bfa71', 'request_id': 'req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:44.198956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2e7f50c4ab40a991b2cdf05a8bfa71', 'request_id': 'req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:44.274574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] The token cache is being invalidate because project 3d2e7f50c4ab40a991b2cdf05a8bfa71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:44.275323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:44.285872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:44.289698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 897/1814] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:43 2022] DELETE /identity/v3/projects/3d2e7f50c4ab40a991b2cdf05a8bfa71 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:44.299747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:44.304853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:44.530834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fec9c-4ea2-4023-9064-e15ccd6485a0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:44.555839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:44.562008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:44.562292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:44.562613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:44.588377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:44.640790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:44.652673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:44.705167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 898/1815] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:44.709720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:44.709720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:44.765730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936134-e615-4384-bdda-af867099af90 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:44.943696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:44.945247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:44.945372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:44.947698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:44.956745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:44.970441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b320e9-dfd5-4cd3-bd0b-2bfe9ade6434 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:44.985284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:44.988218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:44.988510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:44.991474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] PATH_INFO: `/v3/users/ff45e0c9d0ff4044b31437d890f300be` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:44.994227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff45e0c9d0ff4044b31437d890f300be)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:44.999402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:45.122472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff45e0c9d0ff4044b31437d890f300be'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:45.127768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:45.152122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff45e0c9d0ff4044b31437d890f300be'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:45.154376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff45e0c9d0ff4044b31437d890f300be'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:45.160080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:45.165303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:45.169579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff45e0c9d0ff4044b31437d890f300be'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:45.170869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff45e0c9d0ff4044b31437d890f300be'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:45.215149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 918/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 1365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:56:45.244675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 899/1817] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:44 2022] DELETE /identity/v3/users/ff45e0c9d0ff4044b31437d890f300be => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:45.328374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:45.329974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:45.352330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a110af-e5ca-4365-a8a4-dd916d356e4e service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:45.530028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:45.532115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:45.532407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:45.532688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:45.543601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:45.666238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:45.777799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:45.779396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99438a-5aec-4dc4-a15b-898b6f850206 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:45.824310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 919/1818] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:49.967363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:49.969123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:50.283852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22a1d6-a4b0-4802-8c9e-ebe9375a7ad9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:50.331529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:50.332457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:50.332762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:50.333025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] PATH_INFO: `/v3/users/fceead239c1349758418b6a7b171bdcc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:50.351259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fceead239c1349758418b6a7b171bdcc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:50.353738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:50.524230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fceead239c1349758418b6a7b171bdcc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:50.540994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fceead239c1349758418b6a7b171bdcc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:50.545627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fceead239c1349758418b6a7b171bdcc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:50.570304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fceead239c1349758418b6a7b171bdcc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:50.571465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e688aeec-54fe-4726-8049-26d203f03e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fceead239c1349758418b6a7b171bdcc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:50.622470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 900/1819] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:49 2022] DELETE /identity/v3/users/fceead239c1349758418b6a7b171bdcc => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:50.624441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:50.625083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:50.625170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:50.708261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:50.709539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:50.881045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:50.881449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:50.881933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 920/1820] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:50.884948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:50.937883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] MFA Rules not processed for user `229327b6d6c8417ba3450a9c783f993b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:50.947290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:50.963441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:50.965301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:51.056501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:51.140143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d76a5-6229-48c2-a4b5-b8bf62332895 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:51.150423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:51.151127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:51.151408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:51.156099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:51.169100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 901/1821] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:51.170120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:51.176077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:51.192348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:51.193994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:51.217984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5e64-cd9f-424d-b68a-f41300782109 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:51.228534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:51.229813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:51.229813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:51.230070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:51.230884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:51.232916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:51.240446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 921/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:56:51.306097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 902/1823] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:51 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:51.308848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:51.322272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179f3a-c879-4737-8932-55ae6d877c13 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:51.529322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:51.530081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:51.530396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:51.530709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:51.531490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:51.534279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:51.555514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:51.589820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 922/1824] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:51 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:51.594234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:51.613306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bcb37-ef05-497a-b7f7-51cb86447a0f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:51.626775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:51.628841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:51.630332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:51.631932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:51.635382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:51.639179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:51.704594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 903/1825] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:51.709336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:51.720053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937562e-cabf-4b95-8345-880148943e0b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:51.735727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:51.736986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:51.736986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:51.737292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] PATH_INFO: `/v3/projects/d47e4b617a164201a8b1f5587a1a7a5a/users/8367ec81c41e4411be8341efc4590be0/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:51.795609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47e4b617a164201a8b1f5587a1a7a5a, user_id=8367ec81c41e4411be8341efc4590be0, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:51.808625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:51.870400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 923/1826] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:51 2022] PUT /identity/v3/projects/d47e4b617a164201a8b1f5587a1a7a5a/users/8367ec81c41e4411be8341efc4590be0/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:51.875591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:51.887663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:51.897056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:51.899435 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5702ceb-f149-4a3c-bee4-18e553374845 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.076275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.076986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6c0b-2112-4831-b42d-ebabadd1ca8b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.080204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.080528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.080813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.081855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.087472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:52.094161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.095148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.095890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.095890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] PATH_INFO: `/v3/projects/1ae6bf3c2c164e54b4ab0156a4200c5d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.107669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae6bf3c2c164e54b4ab0156a4200c5d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.110066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:52.133420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 904/1827] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:52.138689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:52.161880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19268ee-e105-473f-81e4-e9077b258783 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.179061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.180018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.180329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.180642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] PATH_INFO: `/v3/projects/d47e4b617a164201a8b1f5587a1a7a5a/users/8367ec81c41e4411be8341efc4590be0/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.186534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47e4b617a164201a8b1f5587a1a7a5a, user_id=8367ec81c41e4411be8341efc4590be0, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.193379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:52.230264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 905/1828] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:52 2022] PUT /identity/v3/projects/d47e4b617a164201a8b1f5587a1a7a5a/users/8367ec81c41e4411be8341efc4590be0/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:52.231017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:52.233566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae6bf3c2c164e54b4ab0156a4200c5d', 'request_id': 'req-cb0904fb-d9b8-495b-8fab-65f8a70a139b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.238158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:52.258766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae6bf3c2c164e54b4ab0156a4200c5d', 'request_id': 'req-cb0904fb-d9b8-495b-8fab-65f8a70a139b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.278459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae6bf3c2c164e54b4ab0156a4200c5d', 'request_id': 'req-cb0904fb-d9b8-495b-8fab-65f8a70a139b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.310662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] The token cache is being invalidate because project 1ae6bf3c2c164e54b4ab0156a4200c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:52.310934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.311902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb0904fb-d9b8-495b-8fab-65f8a70a139b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.318577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 924/1829] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:51 2022] DELETE /identity/v3/projects/1ae6bf3c2c164e54b4ab0156a4200c5d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:52.320282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7902-8518-48ef-a3ea-247920df0a15 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.320567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7902-8518-48ef-a3ea-247920df0a15 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.320854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7902-8518-48ef-a3ea-247920df0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.379021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-680e7902-8518-48ef-a3ea-247920df0a15 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:52.380287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-680e7902-8518-48ef-a3ea-247920df0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:52.415903 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 925/1830] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:52.417722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.418016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.418292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.421798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3f08a-0af4-4478-9bda-7d8643da1eac admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.435987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.437015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.437340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.437707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] PATH_INFO: `/v3/users/35548047cda94b2bab4809f0c3718310` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.443359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35548047cda94b2bab4809f0c3718310)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.445442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:52.461717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:52.462973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:52.506391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 926/1831] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:52.507466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:52.533939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99b47-c719-4809-b6c2-3fedb6ed61d5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.543893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:52.558855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.559557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.559840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.560118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.569061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:52.569387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.571128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:52.601913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35548047cda94b2bab4809f0c3718310'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.623300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 927/1832] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:52.623499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35548047cda94b2bab4809f0c3718310'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.624394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35548047cda94b2bab4809f0c3718310'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.624508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:52.640735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35548047cda94b2bab4809f0c3718310'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.641869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0081384a-6826-48cc-aefb-3928a6bad167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35548047cda94b2bab4809f0c3718310'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:52.650527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ed65-262b-4f50-af6d-1d84cc5a6a11 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.674971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.675673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.675964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.676246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.676960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.678948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:52.709468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 906/1833] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:52 2022] DELETE /identity/v3/users/35548047cda94b2bab4809f0c3718310 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:52.715293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7e79-4209-4488-b492-c0fb8d2a3aaf None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.715640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7e79-4209-4488-b492-c0fb8d2a3aaf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.715863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e7e79-4209-4488-b492-c0fb8d2a3aaf None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.717282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 907/1834] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:56:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:52.718425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.718812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.719129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.777951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 928/1835] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:52 2022] POST /identity/v3/projects => generated 409 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:52.779049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:52.779170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:52.780394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:52.788026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:52.813755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:52.949098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 908/1836] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:52.957384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095c2f4-56c4-4eeb-ae3d-ac7455b40272 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:52.974306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:52.975128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:52.975420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:52.975703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:52.976426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:52.978593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:53.018004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 929/1837] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:52 2022] POST /identity/v3/users => generated 305 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:53.022349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:53.039650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0a9c6-0805-490c-8c12-bc330c50587d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:53.055001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:53.055705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.056018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.056280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.057035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:53.058714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:53.085304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 909/1838] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:53.089044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:53.109760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3ced3-6177-4ae3-a7a3-ee8fcb9cb652 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:53.126200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:53.127322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.127844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.128340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.129380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:53.131594 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:53.138376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:53.140806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:53.157249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 930/1839] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:53.163710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:53.182683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086d82b-6ff4-4d89-8289-2c24f428ed87 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:53.199153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1276e-b46f-4c62-bbf6-f3cddbb59d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:53.200312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1276e-b46f-4c62-bbf6-f3cddbb59d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.200803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1276e-b46f-4c62-bbf6-f3cddbb59d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.201308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1276e-b46f-4c62-bbf6-f3cddbb59d61 admin admin] PATH_INFO: `/v3/projects/5dec3802bbc14453a445ff625cfb1731/users/aac73d75a2d243d4bec960ddc11064ad/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.227916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1276e-b46f-4c62-bbf6-f3cddbb59d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dec3802bbc14453a445ff625cfb1731, user_id=aac73d75a2d243d4bec960ddc11064ad, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:53.231060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1276e-b46f-4c62-bbf6-f3cddbb59d61 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:53.281636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 931/1840] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:53 2022] PUT /identity/v3/projects/5dec3802bbc14453a445ff625cfb1731/users/aac73d75a2d243d4bec960ddc11064ad/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:53.296475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6aa1e-1a48-4218-b224-86b8869bedb8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.296767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6aa1e-1a48-4218-b224-86b8869bedb8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.297048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6aa1e-1a48-4218-b224-86b8869bedb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.374119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de429e5-0383-4e68-ae3d-1b12af0a7174 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:53.394482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-08f6aa1e-1a48-4218-b224-86b8869bedb8 None None] MFA Rules not processed for user `aac73d75a2d243d4bec960ddc11064ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:53.395918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-08f6aa1e-1a48-4218-b224-86b8869bedb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:53.547144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:53.549244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.549548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.551048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.580432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:53.605450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 932/1841] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:53.607115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.607419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.607713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.695516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:53.696779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:53.732525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:53.735017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:53.758610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 910/1842] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:53.759756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:53.799926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f52802-d508-4d86-85c3-7c2b027d0dbc service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:53.828670 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:53.831414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:53.831414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:53.831708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:53.835744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:53.847289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:53.882376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:53.930997 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 933/1843] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:56:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:53.942074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 911/1844] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:53 2022] POST /identity/v3/projects => generated 409 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:53.943583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:53.974717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d224-4055-45e4-a2c0-c79270e35785 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:54.111103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:54.112243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.112598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.112969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.113911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:54.117218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:54.159283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 934/1845] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:53 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:54.161806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:54.178848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495bae-3cec-45d4-bebd-de681adb3470 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:54.209405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:54.216179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.216616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.218628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.222552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:54.229977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:54.275456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:54.277728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 912/1846] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:54.297521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e38a2f-1128-43d9-9765-d4153e4b2f3c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:54.317887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:54.321138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.321505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.323256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] PATH_INFO: `/v3/projects/0cea238cbbb947d7b749818fa9f2b554/users/85f3e772bd3b4cdab7ed31b61765e4d2/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.361137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:54.365074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:54.411447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cea238cbbb947d7b749818fa9f2b554, user_id=85f3e772bd3b4cdab7ed31b61765e4d2, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:54.415881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:54.451834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 935/1847] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:54 2022] PUT /identity/v3/projects/0cea238cbbb947d7b749818fa9f2b554/users/85f3e772bd3b4cdab7ed31b61765e4d2/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:56:54.455732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:54.667140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1e5d0-8156-44eb-82a8-264778c775cb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:54.682727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:54.686455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.686794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.687139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.688162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:54.693912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:54.717271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c715c86-b3eb-4d9c-bb2c-4fcdc958fe8b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:54.732675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 936/1848] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:54.736939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:54.775210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a31b1e-e352-425e-8efe-8130874d9125 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:54.799163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce01ba-6ccb-462e-a4fb-09c476a29b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:54.800287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce01ba-6ccb-462e-a4fb-09c476a29b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.800580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce01ba-6ccb-462e-a4fb-09c476a29b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.800860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce01ba-6ccb-462e-a4fb-09c476a29b20 admin admin] PATH_INFO: `/v3/projects/0cea238cbbb947d7b749818fa9f2b554/users/85f3e772bd3b4cdab7ed31b61765e4d2/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.810806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce01ba-6ccb-462e-a4fb-09c476a29b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cea238cbbb947d7b749818fa9f2b554, user_id=85f3e772bd3b4cdab7ed31b61765e4d2, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:54.815682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce01ba-6ccb-462e-a4fb-09c476a29b20 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:54.868626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 937/1849] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:54 2022] PUT /identity/v3/projects/0cea238cbbb947d7b749818fa9f2b554/users/85f3e772bd3b4cdab7ed31b61765e4d2/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:54.881780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.882418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.883012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.924510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:54.938049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:54.938936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:54.939416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:54.939808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:54.970859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:54.977502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:54.996488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] MFA Rules not processed for user `85f3e772bd3b4cdab7ed31b61765e4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:55.000518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:55.010930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 913/1850] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:55.067138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:55.209745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 938/1851] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:55.232343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:55.237997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:55.388209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13b7e-1471-472a-bc1a-5e3c958329c0 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:55.506602 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:55.525029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:55.526281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:55.526907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:55.551508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:55.555081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:55.585917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 914/1852] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:55.861911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:55.883010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87c1cc-1ff6-4b04-88a3-5911dee67b24 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:55.887752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:55.888436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:55.888724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:55.889003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:55.972952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:55.975602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:55.986782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 939/1853] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:56.171609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:56.175667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:56.341365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6d8d-96d4-48f0-b872-0d483e43cebb service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:56.347099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:56.348232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:56.348607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:56.349090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] PATH_INFO: `/v3/projects/759f811ec44646dca7eada2335381f0b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:56.351196 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759f811ec44646dca7eada2335381f0b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:56.353377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:56.519130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759f811ec44646dca7eada2335381f0b', 'request_id': 'req-6c338c48-9a25-494b-b8c2-9d9801878cc0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.530663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:56.545316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759f811ec44646dca7eada2335381f0b', 'request_id': 'req-6c338c48-9a25-494b-b8c2-9d9801878cc0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.557346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759f811ec44646dca7eada2335381f0b', 'request_id': 'req-6c338c48-9a25-494b-b8c2-9d9801878cc0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.586949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] The token cache is being invalidate because project 759f811ec44646dca7eada2335381f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:56.587266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.592286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.595793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 915/1854] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:56 2022] DELETE /identity/v3/projects/759f811ec44646dca7eada2335381f0b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:56.600732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:56.603781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:56.604403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:56.606177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:56.634086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051db77-3193-4bf5-972f-f6c9b477bf9f service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:56.756297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c338c48-9a25-494b-b8c2-9d9801878cc0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:56.774089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:56.775697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:56.775987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:56.776431 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] PATH_INFO: `/v3/projects/baae7c7895d549cbaf23e7c0890bd80b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:56.777873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=baae7c7895d549cbaf23e7c0890bd80b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:56.780340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:56.789455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:56.792592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:56.794189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:56.794923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] PATH_INFO: `/v3/users/52e06b6e38e24579a666fb5caf4962b2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:56.797518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e06b6e38e24579a666fb5caf4962b2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:56.804892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:56.898000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e06b6e38e24579a666fb5caf4962b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.901160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baae7c7895d549cbaf23e7c0890bd80b', 'request_id': 'req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.910503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e06b6e38e24579a666fb5caf4962b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.911517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e06b6e38e24579a666fb5caf4962b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.911640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baae7c7895d549cbaf23e7c0890bd80b', 'request_id': 'req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.921904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baae7c7895d549cbaf23e7c0890bd80b', 'request_id': 'req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.923304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:56.923624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e06b6e38e24579a666fb5caf4962b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.924807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a39bfef5-4814-4c9a-bf4d-f78b6122fe1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e06b6e38e24579a666fb5caf4962b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.943521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] The token cache is being invalidate because project baae7c7895d549cbaf23e7c0890bd80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:56.944211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.946264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4d9fe9d8-c8af-4170-b6ba-cff8940a2a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:56.950980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 940/1855] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:56 2022] DELETE /identity/v3/projects/baae7c7895d549cbaf23e7c0890bd80b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:56:56.950980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328025bc-8299-4f6f-919a-11defb9bd5bc None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:56.950980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328025bc-8299-4f6f-919a-11defb9bd5bc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:56.950980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328025bc-8299-4f6f-919a-11defb9bd5bc None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:56.953312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 941/1856] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:56:56.954454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328025bc-8299-4f6f-919a-11defb9bd5bc None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:56.959955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-328025bc-8299-4f6f-919a-11defb9bd5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:57.017190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 916/1857] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:56 2022] DELETE /identity/v3/users/52e06b6e38e24579a666fb5caf4962b2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:56:57.021150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:57.021454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:57.021763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:57.083893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:57.085150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:57.195729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:57.214488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328025bc-8299-4f6f-919a-11defb9bd5bc None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:57.223248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 917/1858] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:56:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:57.362795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:57.364358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:57.364809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:57.365418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] PATH_INFO: `/v3/users/19441af5b3be48a2960a42168fb48172` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:57.370067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19441af5b3be48a2960a42168fb48172)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:57.372885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:57.477435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19441af5b3be48a2960a42168fb48172'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:57.511583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19441af5b3be48a2960a42168fb48172'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:57.524617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19441af5b3be48a2960a42168fb48172'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:57.527121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19441af5b3be48a2960a42168fb48172'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:57.555897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-93ac17c1-fa69-48c2-98a8-77ba54321d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19441af5b3be48a2960a42168fb48172'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:57.589425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 942/1859] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:56:56 2022] DELETE /identity/v3/users/19441af5b3be48a2960a42168fb48172 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:57.676376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:57.678240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:57.701755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb57a30-b834-4419-8c1b-b39a62cbfc1f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:57.843539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:57.844922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:57.845506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:57.846169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:57.848397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:57.866048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:57.867888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d7a4f-e121-4ade-b9c7-0122d7a27a40 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:57.890569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 918/1860] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:58.242858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:58.243437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:58.243437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:58.282622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] MFA Rules not processed for user `8367ec81c41e4411be8341efc4590be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:58.283926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:58.288907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:58.414993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 943/1861] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:58.415599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:58.416083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:58.416474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:58.472569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] MFA Rules not processed for user `229327b6d6c8417ba3450a9c783f993b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:58.474634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:58.589096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 919/1862] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:58.611730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:58.613680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:58.630135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e453ff-95a5-408e-9379-4cd79c38f635 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:58.636316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:58.637090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:58.637447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:58.637831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:58.639701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:58.651085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:58.652790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:58.663925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 944/1863] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:56:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:56:58.935063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:58.936753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:58.949112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:58.950656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:59.081204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf63dd0-55ca-4819-b36a-78cbf85bb964 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.087863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.089062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.089550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.090071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] PATH_INFO: `/v3/projects/4f6c6a93a75642abb1a579e991e67c00` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.091676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe5375-d741-4f21-9618-68d2f0140c36 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.092775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6c6a93a75642abb1a579e991e67c00)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.095799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.097439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.098528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.098992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.099433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] PATH_INFO: `/v3/projects/8054c80aa0f3428a8d1b1955b328a7fd` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.100834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8054c80aa0f3428a8d1b1955b328a7fd)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.103154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.129825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:59.168897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6c6a93a75642abb1a579e991e67c00', 'request_id': 'req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.180323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6c6a93a75642abb1a579e991e67c00', 'request_id': 'req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.188696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6c6a93a75642abb1a579e991e67c00', 'request_id': 'req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.195941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8054c80aa0f3428a8d1b1955b328a7fd', 'request_id': 'req-536168ad-3001-4f92-a36c-f662bd42a5c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.203936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] The token cache is being invalidate because project 4f6c6a93a75642abb1a579e991e67c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:59.204387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.205296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5dcc5f1e-7b8e-49a1-b231-e4147d94ff71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.210678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8054c80aa0f3428a8d1b1955b328a7fd', 'request_id': 'req-536168ad-3001-4f92-a36c-f662bd42a5c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.210805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 920/1864] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:58 2022] DELETE /identity/v3/projects/4f6c6a93a75642abb1a579e991e67c00 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:59.212362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03886-504e-416e-bd9c-d821d7dff88a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.212362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03886-504e-416e-bd9c-d821d7dff88a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.212572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03886-504e-416e-bd9c-d821d7dff88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.219600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8054c80aa0f3428a8d1b1955b328a7fd', 'request_id': 'req-536168ad-3001-4f92-a36c-f662bd42a5c9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.234745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] The token cache is being invalidate because project 8054c80aa0f3428a8d1b1955b328a7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:56:59.235269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.237474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-536168ad-3001-4f92-a36c-f662bd42a5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:56:59.238989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9ed03886-504e-416e-bd9c-d821d7dff88a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:59.239885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 945/1865] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:56:58 2022] DELETE /identity/v3/projects/8054c80aa0f3428a8d1b1955b328a7fd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:56:59.240655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9ed03886-504e-416e-bd9c-d821d7dff88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:59.245899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec012fc6-c486-4eb8-8652-0218f7b5ca38 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.246952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec012fc6-c486-4eb8-8652-0218f7b5ca38 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.246952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec012fc6-c486-4eb8-8652-0218f7b5ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.274639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ec012fc6-c486-4eb8-8652-0218f7b5ca38 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:59.276959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ec012fc6-c486-4eb8-8652-0218f7b5ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:59.292964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:59.317894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 921/1866] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:56:59.325343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.327138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.327446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.355497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 946/1867] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:59.356658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:59.358957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:59.364303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.364880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.365349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.377754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 922/1868] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:59.379001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.391093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268ca5-3337-4f16-b90b-44eae2ed484e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.391708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:56:59.393756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:56:59.396870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.397940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.398226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.398505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.399252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:59.399564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.401205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.405822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 947/1869] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:56:59.409854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.415288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 923/1870] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:59.419621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.422943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9279-1e42-495b-bc38-803e2c475279 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.431905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de60211-3c91-440e-b765-dc0c7032ce21 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.432626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.433424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.433845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.434479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.435454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:56:59.435966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.437968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.438741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.439176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.439368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.439607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.440464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.442664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.457779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 948/1871] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:56:59.459126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.474150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9ba3-2d73-45c8-94c9-8ae1f7967517 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.478276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 924/1872] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:56:59.479156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.563995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.564713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.565117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.565308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.566217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.573066 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.575099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91aefc7-d2a2-47b5-87eb-7faffc742325 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.583576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.608371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.608371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.608371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.608371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.613137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.649258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:59.658971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 925/1873] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:59.680843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 949/1874] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:59.685182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.685339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.711342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e12c8-9bb1-412d-9768-638de19202ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.809862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a96d3c-fe79-485e-a83b-82d0bb2a052c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.818677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.819608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.820053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.820422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.823160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.827783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.841075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.842445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.843095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.843555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.844910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.847401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.868770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 950/1875] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:56:59 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:56:59.872559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 926/1876] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:59.878216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.880887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.892851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fdc3-2184-4311-8f04-06a6792f32bc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.898740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.899919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.900451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.901033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.902328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.904625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.907382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697e39-5953-481b-8519-a277ccf79f8c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.913921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.914942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.915539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.915831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.916966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.919026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:56:59.929661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 927/1877] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:56:59.931390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.935723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 951/1878] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:56:59.937406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:56:59.965585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1c3f-c523-4daf-8b6d-c2da5fc9d75b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.971653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:59.976923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7678-bfc6-47f4-94dd-5852a832b3aa admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:56:59.977416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5310883-a07b-469e-9a4a-f97aaee738ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.978479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310883-a07b-469e-9a4a-f97aaee738ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.980900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310883-a07b-469e-9a4a-f97aaee738ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.981369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5310883-a07b-469e-9a4a-f97aaee738ed admin admin] PATH_INFO: `/v3/projects/882d0a4110624efa8a2a253ff0e2910a/users/a1539e2220ef41f0bffe46a536633785/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.991290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:56:59.991913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:56:59.992196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:56:59.992472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:56:59.993216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:56:59.994866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.018819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 952/1879] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:00.022829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.023120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5310883-a07b-469e-9a4a-f97aaee738ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=882d0a4110624efa8a2a253ff0e2910a, user_id=a1539e2220ef41f0bffe46a536633785, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.025888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5310883-a07b-469e-9a4a-f97aaee738ed admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.036508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dba16-d176-4928-8e78-ccf735ee289a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.049657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 928/1880] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:56:59 2022] PUT /identity/v3/projects/882d0a4110624efa8a2a253ff0e2910a/users/a1539e2220ef41f0bffe46a536633785/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:00.050973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2660ddd-c1b9-4f13-be2d-75b5af748afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.051897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660ddd-c1b9-4f13-be2d-75b5af748afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.052186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660ddd-c1b9-4f13-be2d-75b5af748afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.052467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2660ddd-c1b9-4f13-be2d-75b5af748afe admin admin] PATH_INFO: `/v3/projects/c3be9043fe5c4434a239284d7c98ee24/users/57525eb6d2e046cf9884be17c61093ea/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.063338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.063613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.063897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.074343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2660ddd-c1b9-4f13-be2d-75b5af748afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3be9043fe5c4434a239284d7c98ee24, user_id=57525eb6d2e046cf9884be17c61093ea, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.078493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2660ddd-c1b9-4f13-be2d-75b5af748afe admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.114721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 953/1881] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:00 2022] PUT /identity/v3/projects/c3be9043fe5c4434a239284d7c98ee24/users/57525eb6d2e046cf9884be17c61093ea/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:00.124859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.125247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.125630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.130235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] MFA Rules not processed for user `a1539e2220ef41f0bffe46a536633785`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:00.131503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:00.216336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] MFA Rules not processed for user `57525eb6d2e046cf9884be17c61093ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:00.219861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:00.267686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 929/1882] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:00.273250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.332205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 954/1883] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:00.336661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.378721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:00.414471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffdc21-b5d6-416d-9eb2-3b416dcd17f1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.420238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.421093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.421202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.421996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.422990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.426117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.472550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648448b2-42e3-44ba-be5d-0607f6cdb48f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.475212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 930/1884] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:00 2022] POST /identity/v3/projects => generated 399 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:00.482328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.579472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.580240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.580633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.581024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.581932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.584806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.614123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:00.651736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 955/1885] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:00 2022] POST /identity/v3/projects => generated 369 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:00.652861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.664877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a554c-0fc2-4d97-9ac6-6f7bf57ea495 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.787990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb78e5-0914-4e5f-adc6-94212af1f10f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.826064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.829132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.830926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.831577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.832458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.835557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.836248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.836532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.836808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.838147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.840488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.840859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.871115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 931/1886] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:00 2022] POST /identity/v3/users => generated 306 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:00.876301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.889880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60a85-578a-4d00-8b6f-78863b637cf5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.899109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 956/1887] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:00 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:00.900453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.916180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.916836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.921563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.921941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.922726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.927021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.930687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa169f1-3bce-4733-ae72-fa4c64d6ad64 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:00.945661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:00.946551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:00.946868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:00.947234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:00.948030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:00.950056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:00.974362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 932/1888] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:00.977984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 957/1889] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:00.979319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:00.981542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.003229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43fdc6-6ed0-4def-869d-a0bfa94abfe6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.004073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d096c33-5e78-4d94-bf6c-fd754a04b1c6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.016705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.025480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.025480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.025480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.025480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] PATH_INFO: `/v3/projects/39c0a15216b8423d9c0b12d40ae8c88e/users/c4ebbc152a7944af8b26b6f985e64e18/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.027344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.028648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.028648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] PATH_INFO: `/v3/projects/33829bb10061456eadea468468df056d/users/b7876590b2434df9ae4dc0ff2b6a14f6/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.057940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c0a15216b8423d9c0b12d40ae8c88e, user_id=c4ebbc152a7944af8b26b6f985e64e18, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.061304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33829bb10061456eadea468468df056d, user_id=b7876590b2434df9ae4dc0ff2b6a14f6, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.061837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.073367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.099462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 933/1890] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:00 2022] PUT /identity/v3/projects/39c0a15216b8423d9c0b12d40ae8c88e/users/c4ebbc152a7944af8b26b6f985e64e18/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:01.100656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.108957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 958/1891] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:00 2022] PUT /identity/v3/projects/33829bb10061456eadea468468df056d/users/b7876590b2434df9ae4dc0ff2b6a14f6/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:01.113247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.179022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:01.230801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26903-b701-4300-8623-e11aa247eeb2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.285267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e783a4-548f-4c70-aabc-f4175fe24b4e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.302660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.303435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.303894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.304182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.304988 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.307950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.333391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 959/1892] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:01.338278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.352765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28e97b-fd2b-49c0-95c4-17f48eeadaa4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.363877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.364899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.365654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.366222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.367150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.369286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.372625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f06e6b-10e2-4311-a357-4036e0697b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.374971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06e6b-10e2-4311-a357-4036e0697b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.375267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06e6b-10e2-4311-a357-4036e0697b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.375554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06e6b-10e2-4311-a357-4036e0697b5e admin admin] PATH_INFO: `/v3/projects/33829bb10061456eadea468468df056d/users/b7876590b2434df9ae4dc0ff2b6a14f6/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.383058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f06e6b-10e2-4311-a357-4036e0697b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33829bb10061456eadea468468df056d, user_id=b7876590b2434df9ae4dc0ff2b6a14f6, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.384506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 934/1893] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:01.389285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.392931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f06e6b-10e2-4311-a357-4036e0697b5e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.403125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fcef8-b4d2-4285-807c-c6142902b0ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.408618 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 960/1894] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:01 2022] PUT /identity/v3/projects/33829bb10061456eadea468468df056d/users/b7876590b2434df9ae4dc0ff2b6a14f6/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:01.421287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.421559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.421873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.454469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] MFA Rules not processed for user `b7876590b2434df9ae4dc0ff2b6a14f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:01.455833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:01.471359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:01.490621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa730cf-5b9f-4ae3-a783-03e68dc7953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.491573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa730cf-5b9f-4ae3-a783-03e68dc7953a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.491859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa730cf-5b9f-4ae3-a783-03e68dc7953a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.492142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa730cf-5b9f-4ae3-a783-03e68dc7953a admin admin] PATH_INFO: `/v3/projects/39c0a15216b8423d9c0b12d40ae8c88e/users/c4ebbc152a7944af8b26b6f985e64e18/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.494160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa730cf-5b9f-4ae3-a783-03e68dc7953a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c0a15216b8423d9c0b12d40ae8c88e, user_id=c4ebbc152a7944af8b26b6f985e64e18, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.496832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa730cf-5b9f-4ae3-a783-03e68dc7953a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.511794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 935/1895] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:01 2022] PUT /identity/v3/projects/39c0a15216b8423d9c0b12d40ae8c88e/users/c4ebbc152a7944af8b26b6f985e64e18/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:01.523696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.523984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.524263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.543685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 961/1896] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:01.556436 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] MFA Rules not processed for user `c4ebbc152a7944af8b26b6f985e64e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:01.557510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.557693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:01.559434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:01.656006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acc395-d82c-4a53-b451-e023753a0ded None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.687817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:01.699266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 936/1897] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:01.708282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.711051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:01.771128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.771811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.772095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.772371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.800966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe326-5828-47c0-98b5-106bfe17f510 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.806145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.806819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.807102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.807377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:01.821422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.822966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.835225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 937/1898] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:01.878602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:01.880079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:01.890575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 962/1899] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:01.923792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:01.933129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95742a25-2277-4e06-bd82-e74070b37641 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:01.937167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97867b-762a-42c4-9d29-6d21f524b851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:01.937934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97867b-762a-42c4-9d29-6d21f524b851 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:01.938152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97867b-762a-42c4-9d29-6d21f524b851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:01.938485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97867b-762a-42c4-9d29-6d21f524b851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:02.017509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97867b-762a-42c4-9d29-6d21f524b851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:02.019524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97867b-762a-42c4-9d29-6d21f524b851 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:02.039397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 938/1900] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:02.300991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:02.317664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:02.358448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:02.486549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50d79-9f92-4c98-a3dc-120872d10e44 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:02.500342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:02.501284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:02.501629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:02.501915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] PATH_INFO: `/v3/users/aac73d75a2d243d4bec960ddc11064ad` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:02.505055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac73d75a2d243d4bec960ddc11064ad)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:02.507338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:02.658623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac73d75a2d243d4bec960ddc11064ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:02.678648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac73d75a2d243d4bec960ddc11064ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:02.693763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac73d75a2d243d4bec960ddc11064ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:02.695537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac73d75a2d243d4bec960ddc11064ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:02.727973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-68129f82-3cdb-4401-9552-4a323d99bf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac73d75a2d243d4bec960ddc11064ad'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:02.743267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 963/1901] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:02 2022] DELETE /identity/v3/users/aac73d75a2d243d4bec960ddc11064ad => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:02.748025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac356-1ece-40a5-9183-8ec549c05fcf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:02.748306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac356-1ece-40a5-9183-8ec549c05fcf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:02.748590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac356-1ece-40a5-9183-8ec549c05fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:02.796148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-091ac356-1ece-40a5-9183-8ec549c05fcf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:02.797499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-091ac356-1ece-40a5-9183-8ec549c05fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:02.927933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 939/1902] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:02.930590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a18b-2582-485a-a01d-6e4b092fbd69 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:02.930590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a18b-2582-485a-a01d-6e4b092fbd69 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:02.930590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a18b-2582-485a-a01d-6e4b092fbd69 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:02.932090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 964/1903] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:57:02.957736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:02.958057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:02.958344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:02.981556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:02.982853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:03.082965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:03.170243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 940/1904] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:57:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:03.284011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a18b-2582-485a-a01d-6e4b092fbd69 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:03.286409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a062a18b-2582-485a-a01d-6e4b092fbd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:03.377564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a18b-2582-485a-a01d-6e4b092fbd69 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:03.381970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:03.382715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:03.383109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:03.383588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:03.397446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:03.398749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:03.414898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 965/1905] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:04.227873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:04.229512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:04.250786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336be00-c9a4-4bf9-960c-0cccc58c57e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:04.260368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9d074-c54a-4cde-9115-e7d713182063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:04.261046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d074-c54a-4cde-9115-e7d713182063 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:04.261397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d074-c54a-4cde-9115-e7d713182063 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:04.261682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d074-c54a-4cde-9115-e7d713182063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:04.276586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9d074-c54a-4cde-9115-e7d713182063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:04.278298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9d074-c54a-4cde-9115-e7d713182063 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:04.290951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 941/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:04.505004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:04.506491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:04.521010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ad11d-49e5-4036-91eb-154e298d58c6 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:04.528240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:04.529884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:04.530587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:04.531156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] PATH_INFO: `/v3/users/57525eb6d2e046cf9884be17c61093ea` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:04.534263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57525eb6d2e046cf9884be17c61093ea)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:04.536775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:04.608828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:04.623972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57525eb6d2e046cf9884be17c61093ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:04.637583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57525eb6d2e046cf9884be17c61093ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:04.653250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57525eb6d2e046cf9884be17c61093ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:04.657365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57525eb6d2e046cf9884be17c61093ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:04.684116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57525eb6d2e046cf9884be17c61093ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:04.698381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 966/1907] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:04 2022] DELETE /identity/v3/users/57525eb6d2e046cf9884be17c61093ea => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:04.700005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:04.700302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:04.700601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:04.725061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:04.727359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:04.806062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:04.807575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:04.833460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 942/1908] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:04.899660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:04.901210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:04.921973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00b382-01b5-4291-afd3-a7374d413d9d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:04.934595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:04.934595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:04.934595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:04.934595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] PATH_INFO: `/v3/projects/5dec3802bbc14453a445ff625cfb1731` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:04.934876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dec3802bbc14453a445ff625cfb1731)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:04.936690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:05.046660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dec3802bbc14453a445ff625cfb1731', 'request_id': 'req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.047044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd129-b12b-4d32-8e12-37e203ad163e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:05.062049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dec3802bbc14453a445ff625cfb1731', 'request_id': 'req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.070481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dec3802bbc14453a445ff625cfb1731', 'request_id': 'req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.099101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] The token cache is being invalidate because project 5dec3802bbc14453a445ff625cfb1731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:05.099411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.101837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.106074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 967/1909] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:04 2022] DELETE /identity/v3/projects/5dec3802bbc14453a445ff625cfb1731 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:05.115021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:05.121646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:05.162613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:05.163658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:05.164257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:05.164685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:05.167776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:05.235261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:05.257469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:05.267591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071772d-c142-4f91-9c5d-1a5c99d1b7ae admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:05.299388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:05.301054 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:05.301218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:05.301674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] PATH_INFO: `/v3/users/85f3e772bd3b4cdab7ed31b61765e4d2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:05.304134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f3e772bd3b4cdab7ed31b61765e4d2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:05.306728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:05.340578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:05.341829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:05.356124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 943/1910] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:05.393318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f3e772bd3b4cdab7ed31b61765e4d2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.403870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f3e772bd3b4cdab7ed31b61765e4d2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.417969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f3e772bd3b4cdab7ed31b61765e4d2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.418941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f3e772bd3b4cdab7ed31b61765e4d2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.436449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f4b0510f-5ee0-46b3-b89c-5342539ecf7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f3e772bd3b4cdab7ed31b61765e4d2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:05.447792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 968/1911] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:05 2022] DELETE /identity/v3/users/85f3e772bd3b4cdab7ed31b61765e4d2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:05.912158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:05.925708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc36c5-d797-4def-8901-6f6553dbf248 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:05.998479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:05.999361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:05.999653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:05.999925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] PATH_INFO: `/v3/projects/0cea238cbbb947d7b749818fa9f2b554` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.001220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cea238cbbb947d7b749818fa9f2b554)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.003528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.066395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cea238cbbb947d7b749818fa9f2b554', 'request_id': 'req-ac6b07e0-90cf-43f5-99c8-03b7878140b3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.075535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cea238cbbb947d7b749818fa9f2b554', 'request_id': 'req-ac6b07e0-90cf-43f5-99c8-03b7878140b3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.082453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cea238cbbb947d7b749818fa9f2b554', 'request_id': 'req-ac6b07e0-90cf-43f5-99c8-03b7878140b3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.094361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] The token cache is being invalidate because project 0cea238cbbb947d7b749818fa9f2b554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:06.094658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.095548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ac6b07e0-90cf-43f5-99c8-03b7878140b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.097474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 944/1912] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:05 2022] DELETE /identity/v3/projects/0cea238cbbb947d7b749818fa9f2b554 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:06.103536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.103536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.104082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.122779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:06.124093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:06.211428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 969/1913] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:06.219348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.219637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.219915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.242725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:06.244316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:06.254831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 945/1914] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:06.258703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.275787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d46cf-4fd0-46a4-bdca-cafe0c13c812 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.280896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.281570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.281880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.282155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.283120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:06.283605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.285240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.301642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 970/1915] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:06.303396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.312814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e11f1-d2c7-46d9-b875-7e07e22491f2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.317513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.318226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.318512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.318788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.319483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.321399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.373993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 946/1916] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:06 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:06.378617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.393377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7583245-b315-4f9c-9c0b-9a64b6a2e95f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.420039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.422226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:06.482241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:06.501005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:06.502023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.502516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.503005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.503122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.513663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.518795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.569109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 971/1917] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:06 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:06.573251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.573842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271b21-3da0-4b9a-9572-6736042d4d91 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.579321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.580414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.581724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.581724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] PATH_INFO: `/v3/projects/c3be9043fe5c4434a239284d7c98ee24` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.583865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3be9043fe5c4434a239284d7c98ee24)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.593898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7a94e-8705-4488-82c9-1f668ff07f1a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.608170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.617037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.617780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.618076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.618462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.624906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.627199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.660953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 972/1918] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:06.662252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.673297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99911ab5-f208-41f5-bfa3-969b4efa1bf2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.679613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.680319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.680607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.680948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.681753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.683400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.699705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 973/1919] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:06.700912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.718795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3c333-6558-4cc9-ba98-3d345cd60cbb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.772703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3be9043fe5c4434a239284d7c98ee24', 'request_id': 'req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.791549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3be9043fe5c4434a239284d7c98ee24', 'request_id': 'req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.806953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3be9043fe5c4434a239284d7c98ee24', 'request_id': 'req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.838033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85124ec-84c1-4dcd-ab63-adbc2fc7eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.838348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] The token cache is being invalidate because project c3be9043fe5c4434a239284d7c98ee24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:06.838651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.840483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:06.840922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85124ec-84c1-4dcd-ab63-adbc2fc7eefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.841222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85124ec-84c1-4dcd-ab63-adbc2fc7eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.841506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85124ec-84c1-4dcd-ab63-adbc2fc7eefc admin admin] PATH_INFO: `/v3/projects/82e06827dbed4ac3914424c6673a7403/users/6bd831d7b70d424ba9d678ae94b4efc4/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.846890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 947/1920] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:06 2022] DELETE /identity/v3/projects/c3be9043fe5c4434a239284d7c98ee24 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:06.857391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:06.860742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:06.889697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cf34c-980a-4e45-8d38-1ee8c8c3ca50 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:06.892503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85124ec-84c1-4dcd-ab63-adbc2fc7eefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e06827dbed4ac3914424c6673a7403, user_id=6bd831d7b70d424ba9d678ae94b4efc4, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.897504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85124ec-84c1-4dcd-ab63-adbc2fc7eefc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.903797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:06.905448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.906407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.906407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] PATH_INFO: `/v3/users/b7876590b2434df9ae4dc0ff2b6a14f6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.907701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7876590b2434df9ae4dc0ff2b6a14f6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:06.910102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:06.929579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 974/1921] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:06 2022] PUT /identity/v3/projects/82e06827dbed4ac3914424c6673a7403/users/6bd831d7b70d424ba9d678ae94b4efc4/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:06.942561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:06.943375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:06.943685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:06.998734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] MFA Rules not processed for user `6bd831d7b70d424ba9d678ae94b4efc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:07.000250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.005586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7876590b2434df9ae4dc0ff2b6a14f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.018679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7876590b2434df9ae4dc0ff2b6a14f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.020091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7876590b2434df9ae4dc0ff2b6a14f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.032020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7876590b2434df9ae4dc0ff2b6a14f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.033117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7876590b2434df9ae4dc0ff2b6a14f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.066963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 948/1922] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:06 2022] DELETE /identity/v3/users/b7876590b2434df9ae4dc0ff2b6a14f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:07.072344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:07.074925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.126604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 975/1923] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:07.139276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:07.141320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.156365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:07.216914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:07.237654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dd27c-2471-4971-b66b-9f11c1ebf8c5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:07.264331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:07.265491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.267057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.271058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9397-69c1-4778-9f05-14feed4b76ea None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:07.271664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] PATH_INFO: `/v3/users/a1539e2220ef41f0bffe46a536633785` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.278555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1539e2220ef41f0bffe46a536633785)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:07.280803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:07.370954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:07.371494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.371945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.372238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.382510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1539e2220ef41f0bffe46a536633785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.393904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1539e2220ef41f0bffe46a536633785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.394744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1539e2220ef41f0bffe46a536633785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.405505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1539e2220ef41f0bffe46a536633785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.406090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1baab9b5-7be3-4d3a-aefa-0650c9ad22b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1539e2220ef41f0bffe46a536633785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.433045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 949/1924] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:07 2022] DELETE /identity/v3/users/a1539e2220ef41f0bffe46a536633785 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:07.442777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.443204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.443717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.460015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:07.461567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:07.468256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:07.469746 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.484533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 976/1925] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:07.495941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:07.497461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.531910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d97b0e-056d-40e2-88bb-037ebefc11fe service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:07.567952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 950/1926] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:07.608411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:07.611920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.616290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:07.617246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.617468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.617778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] PATH_INFO: `/v3/users/6bd831d7b70d424ba9d678ae94b4efc4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.619045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd831d7b70d424ba9d678ae94b4efc4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:07.621132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:07.699232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:07.709105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd831d7b70d424ba9d678ae94b4efc4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.720546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd831d7b70d424ba9d678ae94b4efc4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.736689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd831d7b70d424ba9d678ae94b4efc4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.739241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd831d7b70d424ba9d678ae94b4efc4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.758593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd831d7b70d424ba9d678ae94b4efc4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.760212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915df7d4-54bf-4537-8bcb-821ff1a6ee5b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:07.764855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:07.765897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.766016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.766375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.768188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 977/1927] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:07 2022] DELETE /identity/v3/users/6bd831d7b70d424ba9d678ae94b4efc4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:07.768771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.769414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:07.778036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.785582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:07.789817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:07.791831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0967ac-e1e4-4373-84d0-72db675aa35f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:07.806379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 951/1928] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:07.807857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.808220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.808595 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.828119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:07.829552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.866375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d152b2-b708-4d36-91bd-42e4a5b61c08 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:07.872752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:07.874139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.874380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.874755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] PATH_INFO: `/v3/projects/33829bb10061456eadea468468df056d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:07.876551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33829bb10061456eadea468468df056d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:07.878704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:07.912198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 952/1929] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:07.927170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:07.928753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:07.948225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33829bb10061456eadea468468df056d', 'request_id': 'req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.967437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33829bb10061456eadea468468df056d', 'request_id': 'req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.975657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33829bb10061456eadea468468df056d', 'request_id': 'req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.988120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] The token cache is being invalidate because project 33829bb10061456eadea468468df056d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:07.988492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.989259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8f1d881e-319b-4e02-a456-1e9a7eb9d4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:07.990930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 978/1930] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:07 2022] DELETE /identity/v3/projects/33829bb10061456eadea468468df056d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:07.995594 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210ffcf-2b11-4329-af3a-60ea29327b31 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:07.995948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210ffcf-2b11-4329-af3a-60ea29327b31 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:07.996290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210ffcf-2b11-4329-af3a-60ea29327b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.002597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837d5d8-1381-45cd-a006-b27ebf9ab0ff None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.016061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a210ffcf-2b11-4329-af3a-60ea29327b31 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:08.017034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a210ffcf-2b11-4329-af3a-60ea29327b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.062354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.063287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.063575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.063965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.066036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.069451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:08.103680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 979/1931] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:08.106821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.107123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.107411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.131934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:08.133125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.144269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.146062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.146388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 980/1932] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:08.147409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.152630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:08.159522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72aa01-3227-47b0-99ba-26f661d86798 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.162390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 953/1933] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:08.165363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.166093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.166499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.166780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.167571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:08.167883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.169783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.186940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 981/1934] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:08.187834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.198607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee7a9-9f1f-4461-86d1-ea2e4d4a310c service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.205425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.206133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.206532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.206953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.207662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.209725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.229318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.231729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.254510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5833658-8838-4298-8a92-e51f2d601c31 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.272463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 954/1935] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:08.273800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.353367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.354351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.354640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.355573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] PATH_INFO: `/v3/projects/882d0a4110624efa8a2a253ff0e2910a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.356180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] RBAC: Authorizing `identity:delete_project(project_id=882d0a4110624efa8a2a253ff0e2910a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.359540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.411513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d6387-df17-43c7-92aa-b3eb34e6c3fe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.416650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.417491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.418535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.418824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.419534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.421571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.431327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882d0a4110624efa8a2a253ff0e2910a', 'request_id': 'req-061d2072-d481-4b42-93ba-03d9a627588b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.444842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882d0a4110624efa8a2a253ff0e2910a', 'request_id': 'req-061d2072-d481-4b42-93ba-03d9a627588b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.450820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 955/1936] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:08.455542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.457349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882d0a4110624efa8a2a253ff0e2910a', 'request_id': 'req-061d2072-d481-4b42-93ba-03d9a627588b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.474216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a481fb-d237-4f05-8c23-0e8b9205fe48 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.479964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] The token cache is being invalidate because project 882d0a4110624efa8a2a253ff0e2910a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:08.480533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.481993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.483954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 982/1937] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:08 2022] DELETE /identity/v3/projects/882d0a4110624efa8a2a253ff0e2910a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:08.488198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.490396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.583163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.585673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.586239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.586678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.587457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.589135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d2072-d481-4b42-93ba-03d9a627588b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.589645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.595155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.596152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.596442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.596721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] PATH_INFO: `/v3/users/c4ebbc152a7944af8b26b6f985e64e18` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.598010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ebbc152a7944af8b26b6f985e64e18)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.599964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.601746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:08.613844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 956/1938] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:08.614976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.616739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.631283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9229a-a24b-4f72-92d7-e9318a920fb9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.637015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.638044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.638461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.638584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] PATH_INFO: `/v3/projects/82e06827dbed4ac3914424c6673a7403` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.639787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e06827dbed4ac3914424c6673a7403)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.641888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.665438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ebbc152a7944af8b26b6f985e64e18'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.675531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ebbc152a7944af8b26b6f985e64e18'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.687004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ebbc152a7944af8b26b6f985e64e18'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.688837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ebbc152a7944af8b26b6f985e64e18'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.709450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e06827dbed4ac3914424c6673a7403', 'request_id': 'req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.720609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ebbc152a7944af8b26b6f985e64e18'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.722452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e06827dbed4ac3914424c6673a7403', 'request_id': 'req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.727846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:08.729639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 983/1939] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:08 2022] DELETE /identity/v3/users/c4ebbc152a7944af8b26b6f985e64e18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:08.731269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.733853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.744563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e06827dbed4ac3914424c6673a7403', 'request_id': 'req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.769475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] The token cache is being invalidate because project 82e06827dbed4ac3914424c6673a7403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:08.769799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.772904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9b2e586-80af-49f6-ac0b-86a0cfe0bc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:08.781920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 957/1940] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:08 2022] DELETE /identity/v3/projects/82e06827dbed4ac3914424c6673a7403 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:08.782244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cfae4-ade9-4ac2-98e4-10fdc4900b1b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.782691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cfae4-ade9-4ac2-98e4-10fdc4900b1b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.782978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cfae4-ade9-4ac2-98e4-10fdc4900b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.826436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efd10e-d6d6-4549-98f4-e732e69ff246 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.829725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-951cfae4-ade9-4ac2-98e4-10fdc4900b1b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:08.832731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.833448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.833743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.834021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.834367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-951cfae4-ade9-4ac2-98e4-10fdc4900b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.835255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.836930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.853568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 958/1941] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:08.865739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.866085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.866376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.866475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 984/1942] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:08.872491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.874320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.892884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936140a-5309-4091-95b3-73b4009b4fef admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.896878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:08.898236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:08.901985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ab6dc-3352-40a2-9029-5b039b3a89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.903707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ab6dc-3352-40a2-9029-5b039b3a89e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.904604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ab6dc-3352-40a2-9029-5b039b3a89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.904895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ab6dc-3352-40a2-9029-5b039b3a89e8 admin admin] PATH_INFO: `/v3/projects/784c74d36c0848cbaf26c529c97cd1f2/users/c9166d78de064685b334b1684a23dfb2/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.915341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 959/1943] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:08.919399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.927252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ab6dc-3352-40a2-9029-5b039b3a89e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784c74d36c0848cbaf26c529c97cd1f2, user_id=c9166d78de064685b334b1684a23dfb2, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.929927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23badacb-582f-40d4-a3a8-e46f936e923d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:08.930790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ab6dc-3352-40a2-9029-5b039b3a89e8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.940896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:08.942018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.942563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.942991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.943977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:08.944425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:08.947595 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:08.962580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 985/1944] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:08 2022] PUT /identity/v3/projects/784c74d36c0848cbaf26c529c97cd1f2/users/c9166d78de064685b334b1684a23dfb2/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:08.965648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:08.965938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:08.969695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:08.971706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 960/1945] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:57:08.973286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:08.988322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf4440-94a4-46fb-8e19-92eca46a72a4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.014910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] MFA Rules not processed for user `c9166d78de064685b334b1684a23dfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:09.017310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.062464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:09.074516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.076560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.077144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.077647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.079097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.081928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.102625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 986/1946] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:09.103806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.125274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 961/1947] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:08 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:09.130656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.130765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a3c7-e6d0-4bd8-9397-a0b2638dae73 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.220069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.220795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.221255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.221618 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.222375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.224380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.240408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b930e-4c56-4879-bd98-69b9354a405e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.247498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.248454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.248904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.249503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.250563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.253081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.273424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 987/1948] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:09.274549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.278582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.285382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 962/1949] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:09.285382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.296962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dee63e-9be7-4989-b133-e446e1861977 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.332476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:09.349152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5a64e-c980-49be-ba0a-773fc58fbbdf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.355263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.356788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.356788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.356993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] PATH_INFO: `/v3/projects/39c0a15216b8423d9c0b12d40ae8c88e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.358099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c0a15216b8423d9c0b12d40ae8c88e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.360341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.369935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.370897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.371190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.371473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.372321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.374682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.398312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 963/1950] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:09.399191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.430827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422e1ef-60c1-4ff9-b88a-f93e8654c205 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.434806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c0a15216b8423d9c0b12d40ae8c88e', 'request_id': 'req-696f7def-7f22-439f-b8ca-c387e0eb432e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:09.449035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c0a15216b8423d9c0b12d40ae8c88e', 'request_id': 'req-696f7def-7f22-439f-b8ca-c387e0eb432e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:09.457866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c0a15216b8423d9c0b12d40ae8c88e', 'request_id': 'req-696f7def-7f22-439f-b8ca-c387e0eb432e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:09.467846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:09.486198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] The token cache is being invalidate because project 39c0a15216b8423d9c0b12d40ae8c88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:09.486550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:09.487220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:09.489145 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 988/1951] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:09 2022] DELETE /identity/v3/projects/39c0a15216b8423d9c0b12d40ae8c88e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:09.490030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.495638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.528813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52aed-3db9-4b00-86af-6a64601c881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.529495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52aed-3db9-4b00-86af-6a64601c881e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.529814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52aed-3db9-4b00-86af-6a64601c881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.530088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52aed-3db9-4b00-86af-6a64601c881e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.542070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52aed-3db9-4b00-86af-6a64601c881e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.545174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52aed-3db9-4b00-86af-6a64601c881e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.585387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 964/1952] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:09.590460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.591682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.591682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.620429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7def-7f22-439f-b8ca-c387e0eb432e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.628445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbf4e0-5c14-4507-b4f8-b86b8f27b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.629501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf4e0-5c14-4507-b4f8-b86b8f27b824 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.629715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:09.630192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf4e0-5c14-4507-b4f8-b86b8f27b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.630690 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf4e0-5c14-4507-b4f8-b86b8f27b824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.631338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.631847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbf4e0-5c14-4507-b4f8-b86b8f27b824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.634590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbf4e0-5c14-4507-b4f8-b86b8f27b824 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.644426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 965/1953] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:09.645500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.648365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.656089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 989/1954] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:09.657990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.658505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.659278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.671981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214140b-1384-4ae9-a825-835bb23e9900 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.679823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.680552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.681104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.682001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.683213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.684998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.689265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:09.691794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.698457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 966/1955] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:09.699050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.702932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 990/1956] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:09.704373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.717683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492461c-d512-4b7f-be5f-fbef3a3bbd3f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.723231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89756d-b4a1-4aae-a387-d420f6fb09c6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.724568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.725978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.726596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.727082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] PATH_INFO: `/v3/projects/9e508d6fea42413e8bddaf166c0b8a4d/users/02ad1d2b21de4e209a4ed06c5d10818d/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.730078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.732143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.732766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.733153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] PATH_INFO: `/v3/projects/20f54c8caae544808269afeba55e08f2/users/114faca9dbc64172b4b870012408b067/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.746707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e508d6fea42413e8bddaf166c0b8a4d, user_id=02ad1d2b21de4e209a4ed06c5d10818d, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.749476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.765153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f54c8caae544808269afeba55e08f2, user_id=114faca9dbc64172b4b870012408b067, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.768253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.768696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 967/1957] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:09 2022] PUT /identity/v3/projects/9e508d6fea42413e8bddaf166c0b8a4d/users/02ad1d2b21de4e209a4ed06c5d10818d/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:09.772352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.784753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 991/1958] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:09 2022] PUT /identity/v3/projects/20f54c8caae544808269afeba55e08f2/users/114faca9dbc64172b4b870012408b067/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:09.785813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.852936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc812-769b-40f2-ab4e-cddedfdfb42b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.857623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.858775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.858775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.858990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.859935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:09.860218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.861950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff713c3b-5fe2-4e72-a19f-b6452d5e5217 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.863556 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ba06-2ff7-44b1-a72d-7b20970acb01 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.868557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.869320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.869839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.870190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.871007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.872732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.874766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 968/1959] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:09.875909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.876247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.876528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.884778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 992/1960] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:09.885766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.896283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be093d5-d73e-47a8-89f5-977baf52b167 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:09.901940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:09.902603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:09.902887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:09.903163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:09.903861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:09.905855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:09.907112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:09.911203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] MFA Rules not processed for user `114faca9dbc64172b4b870012408b067`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:09.913147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:09.945212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 993/1961] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:09.945212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:09.993648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:10.015832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 969/1962] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:10.017329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.029650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9acb-99b4-4e7b-8e23-5b3d8fc68aac admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.042904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183dd3b-be89-4224-8c96-61e60e67734a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.049343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.050427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.050836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.051249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.052111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.055164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.058990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.060419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.060738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.061148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] PATH_INFO: `/v3/projects/9e508d6fea42413e8bddaf166c0b8a4d/users/02ad1d2b21de4e209a4ed06c5d10818d/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.063577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e508d6fea42413e8bddaf166c0b8a4d, user_id=02ad1d2b21de4e209a4ed06c5d10818d, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.066650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.104102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 970/1964] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:10 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:10.105367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.112859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 994/1964] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:09 2022] PUT /identity/v3/projects/9e508d6fea42413e8bddaf166c0b8a4d/users/02ad1d2b21de4e209a4ed06c5d10818d/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:10.114573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:10.119977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.211339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e2c1-9599-469d-a17b-de055521fb8a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.217520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75125a88-0b6d-4625-b0b7-5d611df5dfe1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.231514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c0433-0959-439e-b485-b35ff2c8acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.232189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c0433-0959-439e-b485-b35ff2c8acb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.232579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c0433-0959-439e-b485-b35ff2c8acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.233250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c0433-0959-439e-b485-b35ff2c8acb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.235991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c0433-0959-439e-b485-b35ff2c8acb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.238676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c0433-0959-439e-b485-b35ff2c8acb1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.259026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 995/1965] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:10.259026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.259026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.259026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.278839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.279504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.279860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.280317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.292387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] MFA Rules not processed for user `02ad1d2b21de4e209a4ed06c5d10818d`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:10.293655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:10.367185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:10.373680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.375448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.388564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 971/1966] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:10.389876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.403026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bddb9-af1d-4a5a-86b3-325a9ba22889 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.406913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 996/1967] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:10.409500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.410966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.411461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.413087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.414344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.416107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.417534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.419532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:10.429363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 972/1968] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:10.433771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.447838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f62d30-e963-4412-91b4-7f5c9cd3978c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.453116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26350-c926-4333-bc6f-acaf6470bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.454348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26350-c926-4333-bc6f-acaf6470bb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.455776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26350-c926-4333-bc6f-acaf6470bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.456068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26350-c926-4333-bc6f-acaf6470bb1a admin admin] PATH_INFO: `/v3/projects/7eed17c8de1e485b9d84087e979336cf/users/068817e24e174450932ac4d99089f9e9/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.465566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05cec-a837-4458-8287-2c0425a7cdb6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.480995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26350-c926-4333-bc6f-acaf6470bb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eed17c8de1e485b9d84087e979336cf, user_id=068817e24e174450932ac4d99089f9e9, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.485237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26350-c926-4333-bc6f-acaf6470bb1a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.492644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.493418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.493876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.494204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.508425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 973/1969] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:10 2022] PUT /identity/v3/projects/7eed17c8de1e485b9d84087e979336cf/users/068817e24e174450932ac4d99089f9e9/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:10.517359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.521916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.522399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.522774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.526912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:10.555356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 997/1970] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:10.613653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] MFA Rules not processed for user `068817e24e174450932ac4d99089f9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:10.615279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:10.736823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 974/1971] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:10.744812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.761338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ecba2-d9e1-4118-8ba6-852a3a17e16f service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:10.843195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:10.875755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:10.946005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:10.950454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:10.951179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:10.951322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:10.952038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:10.959890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.021950 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 998/1972] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:10 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:11.025490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.030928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e65abe-4c92-4100-a1e5-087fc9673f41 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.118910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:11.127668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.129207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.129551 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.129871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] PATH_INFO: `/v3/users/c9166d78de064685b334b1684a23dfb2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.131383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9166d78de064685b334b1684a23dfb2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.132670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fe76-0e38-464a-a933-53a90a9cf19d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.135398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.138103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.138874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.139245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.139618 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.140578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.143445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.178581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 999/1973] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:11 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:11.183963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.201653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fe7be-2c0b-49ca-b44c-0d8a6041d493 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.207103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.207792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.208084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.208536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.209456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.211132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.222130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9166d78de064685b334b1684a23dfb2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:11.225433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1000/1974] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:11.236662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9166d78de064685b334b1684a23dfb2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:11.238709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9166d78de064685b334b1684a23dfb2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:11.243449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.249321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9166d78de064685b334b1684a23dfb2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:11.249975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5fc24bcb-6e2b-4632-996e-61543a9e2943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9166d78de064685b334b1684a23dfb2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:11.280067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b0dd-439d-438e-8203-d33c1cc607fd admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.286702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.288338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.288781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.289394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] PATH_INFO: `/v3/projects/94ee4f79ec744fa98561d538aca980f1/users/0d4c9eeb42844f038ad46d1af7f4525b/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.303737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 975/1975] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:10 2022] DELETE /identity/v3/users/c9166d78de064685b334b1684a23dfb2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:11.308076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.308371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.308649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.320649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ee4f79ec744fa98561d538aca980f1, user_id=0d4c9eeb42844f038ad46d1af7f4525b, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.324172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.341063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:11.343285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1001/1976] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:11 2022] PUT /identity/v3/projects/94ee4f79ec744fa98561d538aca980f1/users/0d4c9eeb42844f038ad46d1af7f4525b/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:11.345970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:11.350417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.352104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:11.428942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ffd8c-2789-402e-88d1-90a47d0705c2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.435257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.435805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 976/1977] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:11.436941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.437301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.437697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.438514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.440824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.456536 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1002/1978] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:11.457447 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.466441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.468183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:11.469968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b67d4c-a375-4aed-93af-09f12f2870f7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.477429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebccaa5-93b0-4cce-ad2a-667fd9e78e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.478813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebccaa5-93b0-4cce-ad2a-667fd9e78e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.479343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebccaa5-93b0-4cce-ad2a-667fd9e78e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.479812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebccaa5-93b0-4cce-ad2a-667fd9e78e6f admin admin] PATH_INFO: `/v3/projects/94ee4f79ec744fa98561d538aca980f1/users/0d4c9eeb42844f038ad46d1af7f4525b/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.483553 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebccaa5-93b0-4cce-ad2a-667fd9e78e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ee4f79ec744fa98561d538aca980f1, user_id=0d4c9eeb42844f038ad46d1af7f4525b, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.484904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:11.489781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebccaa5-93b0-4cce-ad2a-667fd9e78e6f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.508703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 977/1979] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:11 2022] PUT /identity/v3/projects/94ee4f79ec744fa98561d538aca980f1/users/0d4c9eeb42844f038ad46d1af7f4525b/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:11.520065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.522112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.523675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.557829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e773-d2ca-41a0-b36d-a30bf0d15d8a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.597754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] MFA Rules not processed for user `0d4c9eeb42844f038ad46d1af7f4525b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:11.599503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:11.640518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.641585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.642354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.642819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.673228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:11.699032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 978/1980] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:11.712952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.714392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:11.734015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.735973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.747475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1003/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:11.779398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26219f8-fe67-4f1d-a54b-d98f718682b5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.783839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.784529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.784815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.785092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.795204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:11.796810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:11.807826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 979/1982] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:11.897954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:11.923900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14d18-ed8f-4088-98a2-c4dcfe2651a5 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:11.928434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:11.929106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:11.929392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:11.929703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:11.931551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:12.004804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:12.006691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:12.020999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1004/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:12.075674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:12.077077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:12.101573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd72d4-f5f3-406c-8f86-6a1e4a329a17 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:12.114614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:12.115642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:12.115999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:12.116349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] PATH_INFO: `/v3/projects/784c74d36c0848cbaf26c529c97cd1f2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:12.117672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784c74d36c0848cbaf26c529c97cd1f2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:12.119822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:12.197135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784c74d36c0848cbaf26c529c97cd1f2', 'request_id': 'req-128ef95b-6b4e-4eae-b5c0-c041030441e0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.209202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784c74d36c0848cbaf26c529c97cd1f2', 'request_id': 'req-128ef95b-6b4e-4eae-b5c0-c041030441e0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.240641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784c74d36c0848cbaf26c529c97cd1f2', 'request_id': 'req-128ef95b-6b4e-4eae-b5c0-c041030441e0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.265235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] The token cache is being invalidate because project 784c74d36c0848cbaf26c529c97cd1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:12.267830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.269695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.278966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:12.294168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 980/1984] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:12 2022] DELETE /identity/v3/projects/784c74d36c0848cbaf26c529c97cd1f2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:12.303774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5526f4-98f9-4e56-abd4-3852d727efc2 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:12.363474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:12.478448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:12.479730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:12.480175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:12.480586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] PATH_INFO: `/v3/users/02ad1d2b21de4e209a4ed06c5d10818d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:12.482040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ad1d2b21de4e209a4ed06c5d10818d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:12.485365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:12.582309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:12.582827 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ad1d2b21de4e209a4ed06c5d10818d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.583756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:12.597397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ad1d2b21de4e209a4ed06c5d10818d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.604847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef95b-6b4e-4eae-b5c0-c041030441e0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:12.621937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ad1d2b21de4e209a4ed06c5d10818d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.622717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ad1d2b21de4e209a4ed06c5d10818d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.624297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:12.625208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:12.625488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:12.625800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] PATH_INFO: `/v3/users/068817e24e174450932ac4d99089f9e9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:12.627097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068817e24e174450932ac4d99089f9e9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:12.629043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:12.640304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bc45d29e-3272-431a-8d9a-925613a064cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ad1d2b21de4e209a4ed06c5d10818d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.649287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1005/1985] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:12 2022] DELETE /identity/v3/users/02ad1d2b21de4e209a4ed06c5d10818d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:12.711340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068817e24e174450932ac4d99089f9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.723203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068817e24e174450932ac4d99089f9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.724221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068817e24e174450932ac4d99089f9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.735408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068817e24e174450932ac4d99089f9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.737915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068817e24e174450932ac4d99089f9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:12.746099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:12.794877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:12.795217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:12.795455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:12.797774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 981/1986] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:12 2022] DELETE /identity/v3/users/068817e24e174450932ac4d99089f9e9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:12.821798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:12.823030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:12.918891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1006/1987] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:12.931634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:12.933282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:13.014717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6e34d-56e6-4318-baa5-23fc0897e895 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:13.019064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44e896-3cc3-4c0a-8de5-a84f588b9774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:13.019820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44e896-3cc3-4c0a-8de5-a84f588b9774 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:13.020179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44e896-3cc3-4c0a-8de5-a84f588b9774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:13.020537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44e896-3cc3-4c0a-8de5-a84f588b9774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:13.033164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44e896-3cc3-4c0a-8de5-a84f588b9774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:13.034965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44e896-3cc3-4c0a-8de5-a84f588b9774 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:13.046194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 982/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:13.635696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:13.638128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:13.652784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ebe3-fecc-481a-a049-b6687a0b66f0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:13.668679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:13.683004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:13.688287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:13.689104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] PATH_INFO: `/v3/projects/9e508d6fea42413e8bddaf166c0b8a4d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:13.695349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e508d6fea42413e8bddaf166c0b8a4d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:13.698244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:13.754544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:13.771020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e508d6fea42413e8bddaf166c0b8a4d', 'request_id': 'req-74aaebe1-50c9-47ef-89f4-5da9183cd24f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:13.779417 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e508d6fea42413e8bddaf166c0b8a4d', 'request_id': 'req-74aaebe1-50c9-47ef-89f4-5da9183cd24f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:13.788202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e508d6fea42413e8bddaf166c0b8a4d', 'request_id': 'req-74aaebe1-50c9-47ef-89f4-5da9183cd24f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:13.803231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] The token cache is being invalidate because project 9e508d6fea42413e8bddaf166c0b8a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:13.803538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:13.804302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-74aaebe1-50c9-47ef-89f4-5da9183cd24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:13.805987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1007/1989] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:13 2022] DELETE /identity/v3/projects/9e508d6fea42413e8bddaf166c0b8a4d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:13.811162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:13.811686 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:13.811797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:13.837493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:13.838859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:13.916382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 983/1990] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:13.924571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:13.924854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:13.925134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:13.946506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:13.947560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:13.972150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:13.990130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f92a84-065d-4178-807e-4e9b00fcb1fb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:13.994126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1008/1991] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:14.004913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.005862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.006289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.006671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.007653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:14.008059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.009887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.011563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.014016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:14.029947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 984/1992] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:57:14.031760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.042404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862168-2927-4c3c-af1a-f3756a122f40 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.045324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523dd6f-27c9-4aa8-aaef-53b6cb3e1a55 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.048796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.049893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.050315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.050737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] PATH_INFO: `/v3/projects/7eed17c8de1e485b9d84087e979336cf` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.052256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eed17c8de1e485b9d84087e979336cf)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.053930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.055061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.055839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.056201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.056552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.057326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.060278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.101516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 985/1993] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:14 2022] POST /identity/v3/projects => generated 359 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:14.105918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.131180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eed17c8de1e485b9d84087e979336cf', 'request_id': 'req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.143528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eed17c8de1e485b9d84087e979336cf', 'request_id': 'req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.160954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eed17c8de1e485b9d84087e979336cf', 'request_id': 'req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.187904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] The token cache is being invalidate because project 7eed17c8de1e485b9d84087e979336cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:14.188176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.191861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.193739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1009/1994] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:14 2022] DELETE /identity/v3/projects/7eed17c8de1e485b9d84087e979336cf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:14.198779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.202399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:14.226099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:14.241482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80f4f1-cd64-4117-bdbb-14ed71b46f82 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.375161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.375865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.377887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.379784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.380727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.386550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.386879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6d3d8-490f-41a2-95a0-5bb405140fdf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.398801 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.399771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.400128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.400409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] PATH_INFO: `/v3/users/0d4c9eeb42844f038ad46d1af7f4525b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.404118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4c9eeb42844f038ad46d1af7f4525b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.406101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.446942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 986/1995] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:14 2022] POST /identity/v3/users => generated 280 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:14.449041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.450679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:14.466985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9905f89-b44a-4330-a71c-9b1e475067ee admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.473892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.474840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.475124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.475522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.476400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.478515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.483905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:14.499713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4c9eeb42844f038ad46d1af7f4525b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.523718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 987/1996] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:14.525241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.531428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4c9eeb42844f038ad46d1af7f4525b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.541121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4c9eeb42844f038ad46d1af7f4525b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.542080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4c9eeb42844f038ad46d1af7f4525b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.551722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e91f0-3e66-4455-a0eb-ebc42502c80e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.573125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4c9eeb42844f038ad46d1af7f4525b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:14.580708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8abd-bf99-4bc0-adb1-1fe531aa11e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.581522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8abd-bf99-4bc0-adb1-1fe531aa11e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.585645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8abd-bf99-4bc0-adb1-1fe531aa11e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.585795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1010/1997] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:14 2022] DELETE /identity/v3/users/0d4c9eeb42844f038ad46d1af7f4525b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:14.585877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8abd-bf99-4bc0-adb1-1fe531aa11e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.585877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8abd-bf99-4bc0-adb1-1fe531aa11e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.591520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8abd-bf99-4bc0-adb1-1fe531aa11e3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.621234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 988/1998] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:14.622808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:14.624218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:14.728548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d426c7e-f078-4931-a97e-08c711b66861 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:14.737726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:14.738919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.739102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.739555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] PATH_INFO: `/v3/projects/b427edb26c7f4ae0bfcd59a92ca37335/users/ad59f5f4c8be4890a4e49b5c037ca0ea/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.773910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b427edb26c7f4ae0bfcd59a92ca37335, user_id=ad59f5f4c8be4890a4e49b5c037ca0ea, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:14.779188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:14.808616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1011/1999] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:14 2022] PUT /identity/v3/projects/b427edb26c7f4ae0bfcd59a92ca37335/users/ad59f5f4c8be4890a4e49b5c037ca0ea/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:14.820074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:14.820908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:14.821311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:14.858432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] MFA Rules not processed for user `ad59f5f4c8be4890a4e49b5c037ca0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:14.860040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:14.987977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 989/2000] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:15.027082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.029119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.108683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0973-b7ba-4088-a65b-1235b001352e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.110146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.112209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.122345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.123140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.123486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.123894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.147098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.148607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.178725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1012/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:15.195930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.220566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962f50-7290-4ef0-accc-4074747cfe44 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.226337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.227489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.228182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.228489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] PATH_INFO: `/v3/projects/94ee4f79ec744fa98561d538aca980f1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.229865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ee4f79ec744fa98561d538aca980f1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.232141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.234382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:15.251653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:15.273694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe44e11-6023-4701-a8c3-e2b166626cd6 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.285518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ee4f79ec744fa98561d538aca980f1', 'request_id': 'req-bf9a310c-8880-49cd-b59a-dc962208a52a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.294170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ee4f79ec744fa98561d538aca980f1', 'request_id': 'req-bf9a310c-8880-49cd-b59a-dc962208a52a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.301570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ee4f79ec744fa98561d538aca980f1', 'request_id': 'req-bf9a310c-8880-49cd-b59a-dc962208a52a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.313203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] The token cache is being invalidate because project 94ee4f79ec744fa98561d538aca980f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:15.313505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.314269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf9a310c-8880-49cd-b59a-dc962208a52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.315834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 990/2002] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:15 2022] DELETE /identity/v3/projects/94ee4f79ec744fa98561d538aca980f1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:15.320472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330b66-9cc3-4569-ab79-65032e0a3647 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.320760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330b66-9cc3-4569-ab79-65032e0a3647 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.321039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5330b66-9cc3-4569-ab79-65032e0a3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.332077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.333400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.333871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.334287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] PATH_INFO: `/v3/users/ad59f5f4c8be4890a4e49b5c037ca0ea` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.336030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad59f5f4c8be4890a4e49b5c037ca0ea)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.338767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.339573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e5330b66-9cc3-4569-ab79-65032e0a3647 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:15.341174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e5330b66-9cc3-4569-ab79-65032e0a3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.350946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 991/2003] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:15.358703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.358990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.359574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.378618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:15.379869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.388296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 992/2004] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:15.393514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.395597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad59f5f4c8be4890a4e49b5c037ca0ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.402754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e60e8-1afb-4ebc-8b4a-c03c3ebcf65c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.404549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad59f5f4c8be4890a4e49b5c037ca0ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.408922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.409586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.409909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.410188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.410917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:15.411224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.411945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad59f5f4c8be4890a4e49b5c037ca0ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.412627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad59f5f4c8be4890a4e49b5c037ca0ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.412823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.425825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6970562e-73bd-4b77-932b-d29a2341165e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad59f5f4c8be4890a4e49b5c037ca0ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:15.425994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 993/2005] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:57:15.430533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.431963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1013/2006] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:15 2022] DELETE /identity/v3/users/ad59f5f4c8be4890a4e49b5c037ca0ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:15.432194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.436178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.436596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.436879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.445198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130afc5c-8044-43be-a14b-561220981443 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.454812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:15.455992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.508091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.509022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.509402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.509573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.510301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.512259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.518213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1014/2007] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:15.528406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.530085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.541851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:15.547291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 994/2008] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:15 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:15.548981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.616284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:15.616853 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588f7e-ea19-498f-b8ef-6884f730520d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.633372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376613-90f0-441c-8628-2bde6eadc260 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.638283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.639107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.639393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.639665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.640438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.642711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.666220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 995/2009] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:15 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:15.671562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.678628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.679488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.679775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.680337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.685235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fff7b-324a-4672-82cf-3f448d5ab9f0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.690823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.692287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.695290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.696458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.697004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.697546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.699016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.701591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.703850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1015/2010] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:15.731147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 996/2011] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:15.731725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.744913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384337f-ce1b-40f0-9a98-d50bc2bcb900 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.750493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc52bcf-d691-462a-869a-71bbd6e712e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.751193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc52bcf-d691-462a-869a-71bbd6e712e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.751481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc52bcf-d691-462a-869a-71bbd6e712e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.751764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc52bcf-d691-462a-869a-71bbd6e712e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.752509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc52bcf-d691-462a-869a-71bbd6e712e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.754415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc52bcf-d691-462a-869a-71bbd6e712e7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.768881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1016/2012] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:15.773110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.784860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b610149-7007-4ef0-a472-ec2669c92154 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:15.789545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:15.790460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.790740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.791014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] PATH_INFO: `/v3/projects/95ee40fc68014922a7811d00d20d70d4/users/fd5800d705f14bee8e28bc1838be3fc2/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.807438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ee40fc68014922a7811d00d20d70d4, user_id=fd5800d705f14bee8e28bc1838be3fc2, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:15.810457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:15.824718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 997/2013] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:15 2022] PUT /identity/v3/projects/95ee40fc68014922a7811d00d20d70d4/users/fd5800d705f14bee8e28bc1838be3fc2/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:15.836504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:15.837104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:15.837377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:15.867383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] MFA Rules not processed for user `fd5800d705f14bee8e28bc1838be3fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:15.868889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:15.938400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1017/2014] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:15.950515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:15.952288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:16.031568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147eef5-b97a-4ffd-a348-240334e76ca3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.035506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.036332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.036612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.036882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.048664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.049762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.061123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 998/2015] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:16.082227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.110665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.115143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:16.221683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:16.253623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f4152-8bff-47a7-bb8a-509cb862fdfe None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.259130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.260287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.260758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.261202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] PATH_INFO: `/v3/users/fd5800d705f14bee8e28bc1838be3fc2` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.262611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5800d705f14bee8e28bc1838be3fc2)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.264626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.276931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13be3c-0f61-44ed-9d68-cbe04a96be7a service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.293362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.294580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.294869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.295207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] PATH_INFO: `/v3/projects/b427edb26c7f4ae0bfcd59a92ca37335` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.296504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b427edb26c7f4ae0bfcd59a92ca37335)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.299486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.359446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5800d705f14bee8e28bc1838be3fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.372241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5800d705f14bee8e28bc1838be3fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.378060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:16.380871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b427edb26c7f4ae0bfcd59a92ca37335', 'request_id': 'req-768eb3a3-b195-4520-bd63-5596c80751ef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.383782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5800d705f14bee8e28bc1838be3fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.385250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5800d705f14bee8e28bc1838be3fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.391211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b427edb26c7f4ae0bfcd59a92ca37335', 'request_id': 'req-768eb3a3-b195-4520-bd63-5596c80751ef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.405479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b427edb26c7f4ae0bfcd59a92ca37335', 'request_id': 'req-768eb3a3-b195-4520-bd63-5596c80751ef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.405700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7c43175e-59a0-4690-92c0-124609e0c5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5800d705f14bee8e28bc1838be3fc2'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.414575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1018/2016] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:16 2022] DELETE /identity/v3/users/fd5800d705f14bee8e28bc1838be3fc2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:16.417632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] The token cache is being invalidate because project b427edb26c7f4ae0bfcd59a92ca37335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:16.419265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.419778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.420143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.429637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.432133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-768eb3a3-b195-4520-bd63-5596c80751ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:16.436336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 999/2017] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:16 2022] DELETE /identity/v3/projects/b427edb26c7f4ae0bfcd59a92ca37335 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:16.439613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:16.441397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:16.442114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aadd7-7fa9-405f-94b7-66a38fe03cf3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.442621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aadd7-7fa9-405f-94b7-66a38fe03cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.442957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aadd7-7fa9-405f-94b7-66a38fe03cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.477439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-126aadd7-7fa9-405f-94b7-66a38fe03cf3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:16.478784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-126aadd7-7fa9-405f-94b7-66a38fe03cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:16.557582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1019/2018] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:16.570202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.572307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:16.589917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1000/2019] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:16.597836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.599190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.599614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.638119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:16.639970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:16.654336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1001/2020] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:16.655487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.668513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff4a77-1c9d-4479-8b5f-2ed7f9534d07 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.674373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.674578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ae88b-dfc8-4a0d-bca2-a01486a2c0a5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.675052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.675353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.675614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.676355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:16.676662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.679081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.691572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.692265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1002/2021] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:16.694071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.694388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.694723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.697304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.705315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.706868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.713104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566a26-6544-4843-a597-2131ca41fe7b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.717973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.718839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.719079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.719291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.720030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.722307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.723072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1020/2022] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:16.753130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1003/2023] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:16 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:16.754562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.765200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c66f6-869d-4a20-9388-778f4a4dec19 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.770541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:16.827713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.828512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.828795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.829092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.829861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.831795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.853696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1021/2024] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:16 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:16.858023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.869982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404795bb-d759-4eb3-93fc-df4124e42940 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.875764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.876604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.877128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.878034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.878441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.880126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.891558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1004/2025] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:16.895826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.906234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ca31b-171a-481e-807d-c754982086b7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.911280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3754f-13e0-4e50-bae0-ebc9e0d28061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.911956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3754f-13e0-4e50-bae0-ebc9e0d28061 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.912331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3754f-13e0-4e50-bae0-ebc9e0d28061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.912639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3754f-13e0-4e50-bae0-ebc9e0d28061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.913452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3754f-13e0-4e50-bae0-ebc9e0d28061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.915187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3754f-13e0-4e50-bae0-ebc9e0d28061 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.926023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1022/2026] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:16.930320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:16.942494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307dc24-68c0-46a3-81da-a81d1434bf0c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:16.947712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:16.948603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.948881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.949704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] PATH_INFO: `/v3/projects/7d857756b44e4157b32488cc7ec152be/users/19fcf572b2d1408da41c94a7ab55ca0c/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:16.965815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d857756b44e4157b32488cc7ec152be, user_id=19fcf572b2d1408da41c94a7ab55ca0c, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:16.968400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:16.983062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1005/2027] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:16 2022] PUT /identity/v3/projects/7d857756b44e4157b32488cc7ec152be/users/19fcf572b2d1408da41c94a7ab55ca0c/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:16.993976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:16.993976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:16.994195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:17.025113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] MFA Rules not processed for user `19fcf572b2d1408da41c94a7ab55ca0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:17.026372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:17.136870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1023/2028] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:17.138816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:17.142278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:17.224315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9afd4-89a1-40a4-afb4-7d7b338d9f8e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:17.230660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe4114-4130-4312-9d8a-c795c9a11ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:17.231324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe4114-4130-4312-9d8a-c795c9a11ecf service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:17.231608 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe4114-4130-4312-9d8a-c795c9a11ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:17.231884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe4114-4130-4312-9d8a-c795c9a11ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:17.242107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe4114-4130-4312-9d8a-c795c9a11ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:17.243537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe4114-4130-4312-9d8a-c795c9a11ecf service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:17.253420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1006/2029] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:17.725140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:17.727324 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:17.868415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79dc2-4e17-4b84-b29b-1d85d78f113c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:17.874672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:17.875749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:17.876090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:17.876363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] PATH_INFO: `/v3/projects/95ee40fc68014922a7811d00d20d70d4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:17.877898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ee40fc68014922a7811d00d20d70d4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:17.880255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:17.913845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:17.982884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ee40fc68014922a7811d00d20d70d4', 'request_id': 'req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:17.996013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ee40fc68014922a7811d00d20d70d4', 'request_id': 'req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:18.005440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ee40fc68014922a7811d00d20d70d4', 'request_id': 'req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:18.018978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] The token cache is being invalidate because project 95ee40fc68014922a7811d00d20d70d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:18.019369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:18.020153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-cb18634d-fffd-4fb2-bf77-72bd716e6fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:18.022118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1024/2030] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:17 2022] DELETE /identity/v3/projects/95ee40fc68014922a7811d00d20d70d4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:18.026984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.027575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.027733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.036456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:18.054403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:18.055722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:18.128530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1007/2031] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:18.136543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.136793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.137083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.159388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:18.160623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:18.175527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1025/2032] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:18.176835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.191146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feafaf-4755-4359-87b7-4d651b36ff82 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.211052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.212729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.213229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.214598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.215634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:18.216063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:18.217730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:18.236924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1008/2033] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:18.241898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.259038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3f75f-9074-497c-a370-82492afcfdd8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.266675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.269044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.269341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.269650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.270605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:18.290360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:18.338012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1026/2034] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:18 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:18.338263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.358638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6accc93-e713-42f5-a25e-40f8c0d74f15 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.438166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.439748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.439982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.440269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.441172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:18.444333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:18.476334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1009/2035] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:18 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:18.480207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.491574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33393a3-1c3c-4f0a-b041-c1e1fc2e8257 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.497631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.498314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.499224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.499224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.499592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:18.501237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:18.512862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1027/2036] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:18.516825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.529983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8d485-6c3a-4b4d-b9d5-a7b877e8ad6b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.535925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fedd5-1d51-41e1-b925-0f2ad58586b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.536630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fedd5-1d51-41e1-b925-0f2ad58586b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.536914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fedd5-1d51-41e1-b925-0f2ad58586b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.537189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fedd5-1d51-41e1-b925-0f2ad58586b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.537967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fedd5-1d51-41e1-b925-0f2ad58586b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:18.539589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fedd5-1d51-41e1-b925-0f2ad58586b6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:18.550292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1010/2037] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:18.554538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.567684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e294cd0-f213-4bcc-a510-5be22c2bbadf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.572371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.573288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.573569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.573876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] PATH_INFO: `/v3/projects/04cd5d50ead1469fa9ef092acdf4a9b8/users/002dd1491b2c4fc2af5930d24b79742d/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.589886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cd5d50ead1469fa9ef092acdf4a9b8, user_id=002dd1491b2c4fc2af5930d24b79742d, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:18.592522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:18.608522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1028/2038] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:18 2022] PUT /identity/v3/projects/04cd5d50ead1469fa9ef092acdf4a9b8/users/002dd1491b2c4fc2af5930d24b79742d/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:18.619085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.619432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.619783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:18.658367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] MFA Rules not processed for user `002dd1491b2c4fc2af5930d24b79742d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:18.659626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:18.782068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:18.800520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1011/2039] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:18.865651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:18.868550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:18.984610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fffc99-b58a-40d5-a3df-b54be3d54963 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:18.990795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:18.991534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:18.991892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:18.992234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:19.009388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:19.011856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:19.069761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1029/2040] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:20.403994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:20.414310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2d34b-fe47-40a3-97ed-17f2b85b4911 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:20.418309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:20.418960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:20.419245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:20.419544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:20.421489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:20.490547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:20.492006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fba1a-54e6-4a2a-a561-cfa68210dd73 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:20.502047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1012/2041] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:23.615372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:23.618452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:23.684186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:23.711266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2a5f-21db-48fd-8706-90b6ac409f7b service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:23.716534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:23.717806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:23.718387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:23.719670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] PATH_INFO: `/v3/users/114faca9dbc64172b4b870012408b067` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:23.721412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=114faca9dbc64172b4b870012408b067)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:23.724162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:23.822155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '114faca9dbc64172b4b870012408b067'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:23.837939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '114faca9dbc64172b4b870012408b067'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:23.848144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '114faca9dbc64172b4b870012408b067'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:23.857889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '114faca9dbc64172b4b870012408b067'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:23.888437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '114faca9dbc64172b4b870012408b067'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:23.920765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1030/2042] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:23 2022] DELETE /identity/v3/users/114faca9dbc64172b4b870012408b067 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:23.924218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:23.924711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:23.925214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:23.954288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:23.957055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:24.044364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1013/2043] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:24.097587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:24.099589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:24.217749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edfeea-297d-4bc6-b502-84ef98779acf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:24.222522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca688c7c-3993-4f78-a713-ed97eb88a98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:24.223299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca688c7c-3993-4f78-a713-ed97eb88a98a service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:24.223590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca688c7c-3993-4f78-a713-ed97eb88a98a service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:24.223870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca688c7c-3993-4f78-a713-ed97eb88a98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:24.236193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca688c7c-3993-4f78-a713-ed97eb88a98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:24.237956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca688c7c-3993-4f78-a713-ed97eb88a98a service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:24.249776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1031/2044] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:24.662681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:24.664185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:24.676596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091ff0-71df-4c87-868f-041b296eaee0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:24.683058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:24.684190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:24.684681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:24.685198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] PATH_INFO: `/v3/projects/20f54c8caae544808269afeba55e08f2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:24.686698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f54c8caae544808269afeba55e08f2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:24.689493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:24.769222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f54c8caae544808269afeba55e08f2', 'request_id': 'req-4b805341-bf3a-45fa-86ea-940e251fd75e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:24.781412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f54c8caae544808269afeba55e08f2', 'request_id': 'req-4b805341-bf3a-45fa-86ea-940e251fd75e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:24.790939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f54c8caae544808269afeba55e08f2', 'request_id': 'req-4b805341-bf3a-45fa-86ea-940e251fd75e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:24.806709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] The token cache is being invalidate because project 20f54c8caae544808269afeba55e08f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:24.807305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:24.807928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b805341-bf3a-45fa-86ea-940e251fd75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:24.815359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1014/2045] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:24 2022] DELETE /identity/v3/projects/20f54c8caae544808269afeba55e08f2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:24.815712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:24.816214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:24.816407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:24.849635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:24.851122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:24.931545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1032/2046] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:24.940758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:24.941690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:24.942125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:24.969842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:24.971233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:24.981912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1015/2047] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:24.987776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.018805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7d34-8c33-4cfd-85b3-2ab7f767f0e3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.020181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.021924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:25.023574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.024399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.024742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.025135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.026064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:25.026770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.028708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.032239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:25.052170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f914e9-046b-407b-bd85-46e34d7230b1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.055260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1033/2048] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:25.059572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.068087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.074169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.074458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.074735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] PATH_INFO: `/v3/users/002dd1491b2c4fc2af5930d24b79742d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.076109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=002dd1491b2c4fc2af5930d24b79742d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.078242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.081572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:25.084943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd76112-860b-4d26-af81-66a173c93d34 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.100097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.102301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.102626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.103276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.104044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.106656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.157167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1034/2049] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:25 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:25.157398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002dd1491b2c4fc2af5930d24b79742d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:25.158788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.170225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002dd1491b2c4fc2af5930d24b79742d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:25.172226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002dd1491b2c4fc2af5930d24b79742d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:25.186977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002dd1491b2c4fc2af5930d24b79742d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:25.187696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f460ded8-155e-488d-b717-8439dbd99584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002dd1491b2c4fc2af5930d24b79742d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:25.215053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1016/2050] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:25 2022] DELETE /identity/v3/users/002dd1491b2c4fc2af5930d24b79742d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:25.228739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.229102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.229469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.252254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dac52-7b8e-42da-a14b-2709109e7999 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.256821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:25.258356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:25.325353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.326577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.326577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.326914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.327775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.330369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.331310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1017/2051] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:25.346044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.347696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:25.357645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1035/2052] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:25 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:25.361493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.363377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:25.376446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f56d6-8a06-4e2d-b8bc-9d097b8fab46 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.382438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.383379 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.383721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.384459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.385214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.386938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.398401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1036/2053] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:25.402287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.412445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342da1b-0967-45d7-b885-943170e1ab55 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.417207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b41a5-f2d6-41bc-9ef9-a3924a3ef534 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.417534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.418346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.418654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.418913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.419645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.421245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.421407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d0002-a9b9-44fa-9c7d-3e78e2e0e5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.422107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0002-a9b9-44fa-9c7d-3e78e2e0e5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.422393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0002-a9b9-44fa-9c7d-3e78e2e0e5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.422726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0002-a9b9-44fa-9c7d-3e78e2e0e5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.432837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d0002-a9b9-44fa-9c7d-3e78e2e0e5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.433658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1037/2054] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:25.434513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d0002-a9b9-44fa-9c7d-3e78e2e0e5d2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.437674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.447070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1018/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:25.453252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3c41b-f54e-4070-b8da-a18fd8a99d2e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.458376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.459276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.459563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.459843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] PATH_INFO: `/v3/projects/768cfb5119ce4e40bc10c9427670632c/users/e0eaf52be811415eae6d7173445c4318/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.475214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768cfb5119ce4e40bc10c9427670632c, user_id=e0eaf52be811415eae6d7173445c4318, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.478013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.492509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1038/2056] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:25 2022] PUT /identity/v3/projects/768cfb5119ce4e40bc10c9427670632c/users/e0eaf52be811415eae6d7173445c4318/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:25.503005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.503351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.503728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.542425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] MFA Rules not processed for user `e0eaf52be811415eae6d7173445c4318`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:25.543804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:25.558832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:25.653406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1019/2057] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:25.657739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.687816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:25.768023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9348-ee7d-4506-b19a-0265bbfc58c3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.775410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.776479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.776772 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.777057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.777403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.777860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.778893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:25.780559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:25.822770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa543b4-8359-41f2-a0b1-388b14a3f5e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:25.839275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:25.843688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:25.844355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:25.846341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1039/2058] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:25 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:25.849319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] PATH_INFO: `/v3/projects/04cd5d50ead1469fa9ef092acdf4a9b8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:25.853430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:25.853589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cd5d50ead1469fa9ef092acdf4a9b8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:25.859587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.031852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cd5d50ead1469fa9ef092acdf4a9b8', 'request_id': 'req-8cab9cea-ffc1-413f-bdbe-3a532c024364'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:26.033534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6f44-fd3d-4cc4-9b50-027e7cb593b9 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.064737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cd5d50ead1469fa9ef092acdf4a9b8', 'request_id': 'req-8cab9cea-ffc1-413f-bdbe-3a532c024364'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:26.116887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cd5d50ead1469fa9ef092acdf4a9b8', 'request_id': 'req-8cab9cea-ffc1-413f-bdbe-3a532c024364'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:26.144177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] The token cache is being invalidate because project 04cd5d50ead1469fa9ef092acdf4a9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:26.145519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:26.145843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.146628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cab9cea-ffc1-413f-bdbe-3a532c024364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:26.153942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.154147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1020/2059] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:25 2022] DELETE /identity/v3/projects/04cd5d50ead1469fa9ef092acdf4a9b8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:26.154234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.154234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.154234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.159484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852781-6de1-4096-9fb6-271a46dd3e51 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.160134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852781-6de1-4096-9fb6-271a46dd3e51 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.160707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852781-6de1-4096-9fb6-271a46dd3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.163932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.187434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-31852781-6de1-4096-9fb6-271a46dd3e51 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:26.189536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-31852781-6de1-4096-9fb6-271a46dd3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:26.213615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1040/2060] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:25 2022] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:26.216030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.223072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:26.223977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1021/2061] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:26.232478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.232777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.233057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.253234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f6b6-1202-45b1-88aa-a7add91d1239 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.258849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.260028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.260799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.261204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.262135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.264860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.286515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1041/2062] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:26.287635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.291982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:26.293792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:26.301217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476b58-881c-4a81-814e-add771c44167 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.310681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1022/2063] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:26.312334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.312541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.315297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.315579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.315855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.316627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.321183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.323747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdc130-a0f3-47e3-8ffe-649366c62123 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.335969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.336899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1042/2064] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:26.337098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.337098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.337423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.338293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:26.338735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.340640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.340879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.353837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2209b1-2c31-4d9c-8e50-c9a20356bdaa admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.360218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1023/2065] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:26.362105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8134-d752-4e65-afe4-058cacabacb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.362932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8134-d752-4e65-afe4-058cacabacb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.363211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8134-d752-4e65-afe4-058cacabacb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.363495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8134-d752-4e65-afe4-058cacabacb5 admin admin] PATH_INFO: `/v3/projects/25c89eac56444d1484acf9f598712167/users/993eb94bfc8f4320a3a33ebeefb0954c/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.365793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.376180 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b6822-59da-4415-97d7-ba3bd94dfd6f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.379914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec8134-d752-4e65-afe4-058cacabacb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c89eac56444d1484acf9f598712167, user_id=993eb94bfc8f4320a3a33ebeefb0954c, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.381034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.381886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.382173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.382457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.383122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec8134-d752-4e65-afe4-058cacabacb5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.383457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.385363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.392480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:26.398105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1043/2066] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:26 2022] PUT /identity/v3/projects/25c89eac56444d1484acf9f598712167/users/993eb94bfc8f4320a3a33ebeefb0954c/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:26.409504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.409835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.410118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.415202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1024/2067] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:26.418959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.437246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] MFA Rules not processed for user `993eb94bfc8f4320a3a33ebeefb0954c`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:26.438683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:26.470265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:26.488230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152a52a-11f4-4cd7-a4ac-9fe2af3bb841 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.495454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.496171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.496402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.496810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.497658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.501947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.514758 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1044/2068] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:26.519604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.528095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1025/2069] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:26.533137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.534881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea6e5e-bf64-4849-84c0-854c8626cbab None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.540391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.541056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.541335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.541627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.542339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.544415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.550837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f5868-4050-4a54-a49c-ddd7369fd730 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.555952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.556826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.557306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.557781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.558682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.560741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.573653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1026/2070] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:26.576585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.585635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1045/2071] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:26.588990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819ed-3581-47c6-95b0-a8721c5c55ed admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.589811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.679349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.680311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.680601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.680879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.681646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.682782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474db12-b184-4ace-b96d-fe77878cd085 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.683400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.687951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.688797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.689077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.689353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.690080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.692106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.695243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1027/2072] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:26.699330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.712398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16463-65b3-42a3-a72f-618d0b8f65ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.719809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62022ac2-33bf-400c-af4f-f556e33704e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.720905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62022ac2-33bf-400c-af4f-f556e33704e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.721215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62022ac2-33bf-400c-af4f-f556e33704e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.721449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62022ac2-33bf-400c-af4f-f556e33704e2 admin admin] PATH_INFO: `/v3/projects/c9b67e3e065240a0b23f03de9ea37a64/users/7386d27b716c47f09d98874d22afd5d3/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.725483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1046/2073] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:26.731944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.739806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62022ac2-33bf-400c-af4f-f556e33704e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b67e3e065240a0b23f03de9ea37a64, user_id=7386d27b716c47f09d98874d22afd5d3, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.743250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62022ac2-33bf-400c-af4f-f556e33704e2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.745096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7217d8-9ab4-4ba4-b5c4-6927afd7476b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.752236 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.752913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.753199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.753475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.754275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.755866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.759525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1028/2074] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:26 2022] PUT /identity/v3/projects/c9b67e3e065240a0b23f03de9ea37a64/users/7386d27b716c47f09d98874d22afd5d3/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:26.770701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.771260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.771736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.772264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1047/2075] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:26.773137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.783692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28686f1-4a70-404e-8818-8a1e511111cc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.801780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] MFA Rules not processed for user `7386d27b716c47f09d98874d22afd5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:26.802940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:26.845234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:26.859451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.860409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.860992 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.861802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] PATH_INFO: `/v3/projects/39880125f2a34d88b7aa88c9093ba3da/users/3d3f65d026624f18a3846c91bb8f35db/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.876345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1029/2076] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:26.877389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39880125f2a34d88b7aa88c9093ba3da, user_id=3d3f65d026624f18a3846c91bb8f35db, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.880197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.888486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.890246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:26.895228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1048/2077] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:26 2022] PUT /identity/v3/projects/39880125f2a34d88b7aa88c9093ba3da/users/3d3f65d026624f18a3846c91bb8f35db/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:26.899089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:26.928263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:26.958550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffa326-4ca0-4fcd-9c84-87e8182c0a58 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.968986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55107c7a-6199-4407-a81e-9764e2433722 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:26.974894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:26.975630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:26.975881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:26.976208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:26.977616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:26.979698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:26.990952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1049/2078] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:26.996090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:27.010811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cfc81-6248-451a-bd7e-dbb88889b03e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:27.017487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:27.017685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23c60e-7f77-40a4-953d-250045651429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:27.018208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:27.018502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:27.018779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:27.018886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c60e-7f77-40a4-953d-250045651429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:27.019233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c60e-7f77-40a4-953d-250045651429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:27.019656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23c60e-7f77-40a4-953d-250045651429 admin admin] PATH_INFO: `/v3/projects/39880125f2a34d88b7aa88c9093ba3da/users/3d3f65d026624f18a3846c91bb8f35db/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:27.022256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23c60e-7f77-40a4-953d-250045651429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39880125f2a34d88b7aa88c9093ba3da, user_id=3d3f65d026624f18a3846c91bb8f35db, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:27.026207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23c60e-7f77-40a4-953d-250045651429 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:27.038231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1050/2079] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:26 2022] PUT /identity/v3/projects/39880125f2a34d88b7aa88c9093ba3da/users/3d3f65d026624f18a3846c91bb8f35db/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:27.048445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:27.048740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:27.049023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:27.075674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] MFA Rules not processed for user `3d3f65d026624f18a3846c91bb8f35db`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:27.076158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:27.076811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:27.077639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:27.087189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1030/2080] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:27.146990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1051/2081] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:27.160171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:27.161735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:27.222503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5e5-3c6c-4368-b19a-685088601f96 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:27.272149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:27.272872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:27.273057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:27.273333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:27.275352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:27.286870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:27.357923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:27.360894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:27.373982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1031/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:28.835328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:28.837243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:28.886810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:28.918751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fb667-4505-411c-be3e-a557cf826c99 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:28.927068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:28.927948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:28.928233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:28.928519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] PATH_INFO: `/v3/users/19fcf572b2d1408da41c94a7ab55ca0c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:28.931254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fcf572b2d1408da41c94a7ab55ca0c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:28.937380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:29.006352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fcf572b2d1408da41c94a7ab55ca0c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:29.023434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fcf572b2d1408da41c94a7ab55ca0c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:29.024113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:29.029411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:29.041389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fcf572b2d1408da41c94a7ab55ca0c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:29.042144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fcf572b2d1408da41c94a7ab55ca0c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:29.050997 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90297d-d431-47f7-9697-accaf4c04b31 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:29.055717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:29.056387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:29.056673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:29.057307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:29.059081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e3967c6f-b267-4c47-a4aa-a643c2eb3321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fcf572b2d1408da41c94a7ab55ca0c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:29.062169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:29.071385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1052/2083] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:28 2022] DELETE /identity/v3/users/19fcf572b2d1408da41c94a7ab55ca0c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:29.076218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:29.076582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:29.076947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:29.106557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:29.108451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:29.185358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:29.187188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:29.201780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1032/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:29.242529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1053/2085] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:29.256290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:29.258374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:29.377693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7300-c49b-499d-bdfe-fa0c6e762244 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:29.465367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:29.466222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:29.466547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:29.467152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:29.478747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:29.480533 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:29.502988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1033/2086] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:29.975761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:29.977319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:30.044998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0538cb-c3ca-4fff-a845-7f640b81219c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:30.051114 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:30.052355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:30.053174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:30.053751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:30.054189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:30.054633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:30.057209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:30.071187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617abc-2e02-410e-ae61-4e1922e8e42a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:30.075064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:30.076897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:30.078557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:30.078883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:30.079162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] PATH_INFO: `/v3/projects/7d857756b44e4157b32488cc7ec152be` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:30.080994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d857756b44e4157b32488cc7ec152be)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:30.083312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:30.086377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:30.164965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:30.168257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db465ea-75a8-4534-92ec-7ce59006ca11 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:30.182489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d857756b44e4157b32488cc7ec152be', 'request_id': 'req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:30.186936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1054/2087] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:30.193708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d857756b44e4157b32488cc7ec152be', 'request_id': 'req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:30.201532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d857756b44e4157b32488cc7ec152be', 'request_id': 'req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:30.225702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] The token cache is being invalidate because project 7d857756b44e4157b32488cc7ec152be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:30.227707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:30.229021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6e4fe6b8-bc8d-4f5d-913e-aeaab1d916bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:30.245628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1034/2088] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:30 2022] DELETE /identity/v3/projects/7d857756b44e4157b32488cc7ec152be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:32.181129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fb886-ecc2-40af-b679-3533a74823b8 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:32.182025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fb886-ecc2-40af-b679-3533a74823b8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:32.182327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fb886-ecc2-40af-b679-3533a74823b8 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:32.183928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1055/2089] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:57:32.194142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:32.194687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:32.194687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:32.214140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:32.215361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:32.265471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fb886-ecc2-40af-b679-3533a74823b8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:32.268020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6f6fb886-ecc2-40af-b679-3533a74823b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:32.289877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1035/2090] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:32.301691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:32.303242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:32.320439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda09934-d1df-454b-aa9e-9e2ce81e57d6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:32.325591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:32.326281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:32.326564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:32.326839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:32.335632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:32.337228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:32.340069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fb886-ecc2-40af-b679-3533a74823b8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:32.344803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:32.345722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:32.346182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:32.346475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] PATH_INFO: `/v3/users/4705b076f9e34b1c92f0ac5e238c5292` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:32.347077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1036/2091] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:32.349661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4705b076f9e34b1c92f0ac5e238c5292)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:32.351822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:32.412414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4705b076f9e34b1c92f0ac5e238c5292'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.424134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4705b076f9e34b1c92f0ac5e238c5292'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.434332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4705b076f9e34b1c92f0ac5e238c5292'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.435310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4705b076f9e34b1c92f0ac5e238c5292'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.451359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-37a63f1b-ee04-4fac-82e4-9ecf0077f650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4705b076f9e34b1c92f0ac5e238c5292'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.464400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1056/2092] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:32 2022] DELETE /identity/v3/users/4705b076f9e34b1c92f0ac5e238c5292 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:32.678590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:32.699865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a7c9-de92-47f9-8ef1-bfde6e42a299 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:32.796598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:32.798098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:32.798478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:32.798774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] PATH_INFO: `/v3/projects/b42690d573304a2c93def8d98ffe261e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:32.800075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42690d573304a2c93def8d98ffe261e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:32.802109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:32.822414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:32.859678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42690d573304a2c93def8d98ffe261e', 'request_id': 'req-26cdfc10-1a30-4da2-bc0f-d825dddef2db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.870985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42690d573304a2c93def8d98ffe261e', 'request_id': 'req-26cdfc10-1a30-4da2-bc0f-d825dddef2db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.879290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42690d573304a2c93def8d98ffe261e', 'request_id': 'req-26cdfc10-1a30-4da2-bc0f-d825dddef2db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.896737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] The token cache is being invalidate because project b42690d573304a2c93def8d98ffe261e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:32.897020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.902108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-26cdfc10-1a30-4da2-bc0f-d825dddef2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:32.905761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1037/2093] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:32 2022] DELETE /identity/v3/projects/b42690d573304a2c93def8d98ffe261e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:32.912217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:32.912508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:32.912787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:32.935114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:32.936760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:32.971210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:33.018356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1057/2094] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:33.031397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.031836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.032680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.057978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:33.059239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:33.067884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1038/2095] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:33.072517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.082832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef694-1924-48e4-821b-92fad9c34d3d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.088288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.089029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.089382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.089698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.090474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:33.090770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.092601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.107564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1058/2096] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:33.112697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.124853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd8357-9d46-4ec4-98cf-0a1a79b9bd90 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.130281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.131160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.131569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.131910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.132713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.135429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.176035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1039/2097] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:33 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:33.181344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.193869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ea47d-da37-4406-8f22-11420ca077c7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.279574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.280753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.281278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.281893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.283094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.287013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.318043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1059/2098] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:33 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:33.319323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.330696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71089a5d-93b5-47d0-a633-74b039c13184 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.336429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.337838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.338683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.338975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.339966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.341969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.357631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1040/2099] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:33.359962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.371266 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766b3c7-f179-4133-8926-e2b1c4c16f3a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.377632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717799-c315-4ee0-93b3-f1391cf6e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.378412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717799-c315-4ee0-93b3-f1391cf6e79e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.378669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717799-c315-4ee0-93b3-f1391cf6e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.378948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717799-c315-4ee0-93b3-f1391cf6e79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.379756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717799-c315-4ee0-93b3-f1391cf6e79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.381419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717799-c315-4ee0-93b3-f1391cf6e79e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.398945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1060/2100] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:33.405737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.416254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65adbe-72e7-432d-ac82-d195c0cb421a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.421295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.422380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.422754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.423039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] PATH_INFO: `/v3/projects/45473d61071b4ca991879ef0df1eacb6/users/df126d4b9ffd4593871706005b0cb346/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.440818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45473d61071b4ca991879ef0df1eacb6, user_id=df126d4b9ffd4593871706005b0cb346, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.444019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.458541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1041/2101] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:33 2022] PUT /identity/v3/projects/45473d61071b4ca991879ef0df1eacb6/users/df126d4b9ffd4593871706005b0cb346/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:33.469012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.469336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.469652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.498027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] MFA Rules not processed for user `df126d4b9ffd4593871706005b0cb346`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:33.499238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:33.573963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1061/2102] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:33.585268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:33.587027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:33.657437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ab0d6-4c23-4b8c-b320-c92e371aa424 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:33.661450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c8a6-69fe-4d5e-b8ed-a70faa1d43ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:33.662093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c8a6-69fe-4d5e-b8ed-a70faa1d43ca service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:33.662382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c8a6-69fe-4d5e-b8ed-a70faa1d43ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:33.662661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c8a6-69fe-4d5e-b8ed-a70faa1d43ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:33.671430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c8a6-69fe-4d5e-b8ed-a70faa1d43ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:33.673004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c8a6-69fe-4d5e-b8ed-a70faa1d43ca service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:33.682468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1042/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:34.263774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:34.265451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:34.294425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:34.338625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d16d7-1c4f-45d3-bece-f1e0a970526d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:34.343322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:34.344314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:34.344694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:34.344977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] PATH_INFO: `/v3/users/e0eaf52be811415eae6d7173445c4318` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:34.346224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0eaf52be811415eae6d7173445c4318)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:34.348395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:34.406847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0eaf52be811415eae6d7173445c4318'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:34.414394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0eaf52be811415eae6d7173445c4318'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:34.422078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0eaf52be811415eae6d7173445c4318'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:34.422969 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0eaf52be811415eae6d7173445c4318'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:34.436329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0eaf52be811415eae6d7173445c4318'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:34.443476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1062/2104] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:34 2022] DELETE /identity/v3/users/e0eaf52be811415eae6d7173445c4318 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:34.448336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:34.448788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:34.448967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:34.471588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:34.472829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:34.518517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:34.542559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1043/2105] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:34.553117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:34.554532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:34.623055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbd90a-9f63-4d38-b11d-4f2dffd7acbc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:34.626995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:34.627655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:34.627944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:34.628225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:34.637978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:34.639468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:34.649424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1063/2106] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:34.939281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:34.940740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:34.955930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ca97-4b5e-434a-8a9c-35d3b5229588 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:34.960915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:34.962135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:34.962404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:34.962680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] PATH_INFO: `/v3/projects/768cfb5119ce4e40bc10c9427670632c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:34.964538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=768cfb5119ce4e40bc10c9427670632c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:34.967014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:35.026937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768cfb5119ce4e40bc10c9427670632c', 'request_id': 'req-9a6faa85-20e8-4471-8985-79475ee0c34e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.036819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768cfb5119ce4e40bc10c9427670632c', 'request_id': 'req-9a6faa85-20e8-4471-8985-79475ee0c34e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.046469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768cfb5119ce4e40bc10c9427670632c', 'request_id': 'req-9a6faa85-20e8-4471-8985-79475ee0c34e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.062117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] The token cache is being invalidate because project 768cfb5119ce4e40bc10c9427670632c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:35.062412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.063118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.074182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1044/2107] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:34 2022] DELETE /identity/v3/projects/768cfb5119ce4e40bc10c9427670632c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:35.074280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:35.080660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a57a2e-9ed4-44c6-b574-18bb4a9b7243 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:35.137841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:35.162477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:35.163364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:35.163644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:35.163917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] PATH_INFO: `/v3/users/993eb94bfc8f4320a3a33ebeefb0954c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:35.165105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=993eb94bfc8f4320a3a33ebeefb0954c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:35.167082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:35.223433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993eb94bfc8f4320a3a33ebeefb0954c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.231964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993eb94bfc8f4320a3a33ebeefb0954c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.240848 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993eb94bfc8f4320a3a33ebeefb0954c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.241871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993eb94bfc8f4320a3a33ebeefb0954c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.255684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993eb94bfc8f4320a3a33ebeefb0954c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.261867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1064/2108] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:35 2022] DELETE /identity/v3/users/993eb94bfc8f4320a3a33ebeefb0954c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:35.580082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:35.581655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:35.595225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6faa85-20e8-4471-8985-79475ee0c34e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:35.659368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:35.660238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:35.660519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:35.660794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] PATH_INFO: `/v3/projects/25c89eac56444d1484acf9f598712167` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:35.662031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c89eac56444d1484acf9f598712167)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:35.663951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:35.721023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c89eac56444d1484acf9f598712167', 'request_id': 'req-5326f22c-1106-49dd-96a6-bc5ee94b364d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.730540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c89eac56444d1484acf9f598712167', 'request_id': 'req-5326f22c-1106-49dd-96a6-bc5ee94b364d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.737410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c89eac56444d1484acf9f598712167', 'request_id': 'req-5326f22c-1106-49dd-96a6-bc5ee94b364d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.742213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:35.749116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] The token cache is being invalidate because project 25c89eac56444d1484acf9f598712167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:35.749709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.751133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.756030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1045/2109] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:35 2022] DELETE /identity/v3/projects/25c89eac56444d1484acf9f598712167 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:35.756867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:35.762479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:35.781559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c471f5-fea6-4126-a778-bdd918173e8f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:35.863063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:35.864030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:35.864316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:35.864596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] PATH_INFO: `/v3/users/3d3f65d026624f18a3846c91bb8f35db` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:35.865858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3f65d026624f18a3846c91bb8f35db)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:35.867797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:35.924563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3f65d026624f18a3846c91bb8f35db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.932708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3f65d026624f18a3846c91bb8f35db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.940730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3f65d026624f18a3846c91bb8f35db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.941643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3f65d026624f18a3846c91bb8f35db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.943613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:35.957110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4572ca9a-498c-4d1f-b7dc-f3b0f68aa241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3f65d026624f18a3846c91bb8f35db'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:35.963315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1065/2110] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:35 2022] DELETE /identity/v3/users/3d3f65d026624f18a3846c91bb8f35db => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:36.387407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:36.388908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:36.407954 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f22c-1106-49dd-96a6-bc5ee94b364d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:36.473506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:36.478164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.478523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.478815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] PATH_INFO: `/v3/projects/39880125f2a34d88b7aa88c9093ba3da` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.480139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39880125f2a34d88b7aa88c9093ba3da)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:36.482337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:36.539178 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39880125f2a34d88b7aa88c9093ba3da', 'request_id': 'req-d50dee58-8735-423c-b7d6-9467b5d17b6e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:36.550822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39880125f2a34d88b7aa88c9093ba3da', 'request_id': 'req-d50dee58-8735-423c-b7d6-9467b5d17b6e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:36.558095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39880125f2a34d88b7aa88c9093ba3da', 'request_id': 'req-d50dee58-8735-423c-b7d6-9467b5d17b6e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:36.570376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] The token cache is being invalidate because project 39880125f2a34d88b7aa88c9093ba3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:36.570642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:36.571298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d50dee58-8735-423c-b7d6-9467b5d17b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:36.572964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1046/2111] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:36 2022] DELETE /identity/v3/projects/39880125f2a34d88b7aa88c9093ba3da => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:36.577954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.578318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.578669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.597636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:36.598898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:36.668334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1066/2112] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:36.677514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.678076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.678076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.701506 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:36.702788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:36.711318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1047/2113] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:36.715946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:36.727688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eda680-5aa8-47f0-8fa2-7e3789b78bd5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:36.733375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:36.734777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.735390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.735991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.736515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:36.736750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:36.738403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:36.757641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1067/2114] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:36.759882 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:36.771711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c009d-3b4e-4777-ab82-17e858e77f9b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:36.780476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:36.782091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.782547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.783052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.783942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:36.786063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:36.816101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1048/2115] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:36 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:36.820530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:36.832348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803c946-f168-481a-b2bb-eec1595472cf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:36.896511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:36.897288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.897517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.897909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.898785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:36.900767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:36.920578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1068/2116] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:36 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:36.925357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:36.935945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa8f51-0c33-4919-b190-55e55cfaaddb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:36.941115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:36.941816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.942105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.942415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.943215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:36.944832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:36.955956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1049/2117] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:36.959920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:36.971010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bfe6-5de1-44a5-9179-421ad40d1d8a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:36.979668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cef55-c0e9-441a-9a03-93c7a3b8abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:36.980774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cef55-c0e9-441a-9a03-93c7a3b8abff admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:36.981244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cef55-c0e9-441a-9a03-93c7a3b8abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:36.981939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cef55-c0e9-441a-9a03-93c7a3b8abff admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:36.983132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cef55-c0e9-441a-9a03-93c7a3b8abff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:36.985817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cef55-c0e9-441a-9a03-93c7a3b8abff admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:36.998353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1069/2118] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:37.003500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:37.015836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839e453-d1bc-4bac-a3c8-f545339a3ff1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:37.022309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:37.023195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:37.023483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:37.023759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] PATH_INFO: `/v3/projects/1240c431367b4578b62ec6f485e96531/users/74be13d0851b49e79263c4508d9fb5ff/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:37.041409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1240c431367b4578b62ec6f485e96531, user_id=74be13d0851b49e79263c4508d9fb5ff, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:37.044184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:37.060333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1050/2119] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:37 2022] PUT /identity/v3/projects/1240c431367b4578b62ec6f485e96531/users/74be13d0851b49e79263c4508d9fb5ff/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:37.071710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:37.072341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:37.072341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:37.101522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] MFA Rules not processed for user `74be13d0851b49e79263c4508d9fb5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:37.102754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:37.143876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:37.175958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1070/2120] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:37.190865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:37.192575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:37.221745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:37.270530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac0fae-e03f-49b7-8bca-b3d5a9d2f03a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:37.274097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:37.274784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:37.275100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:37.275342 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:37.284248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:37.285929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:37.295353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1051/2121] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:42.225870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:42.227575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:42.296395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234341c-b738-4c7e-af80-1ba2042f4378 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:42.301261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:42.302157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:42.302438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:42.302714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] PATH_INFO: `/v3/users/df126d4b9ffd4593871706005b0cb346` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:42.303897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=df126d4b9ffd4593871706005b0cb346)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:42.305944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:42.362816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df126d4b9ffd4593871706005b0cb346'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.378208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df126d4b9ffd4593871706005b0cb346'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.382466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:42.390077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:42.390584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df126d4b9ffd4593871706005b0cb346'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.391724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df126d4b9ffd4593871706005b0cb346'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.406388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4c3d1816-0d76-4417-a787-1d3714a058ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df126d4b9ffd4593871706005b0cb346'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.411134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a15aa-3b9d-4cf6-9357-4fc10259f55f service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:42.417258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1071/2122] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:42 2022] DELETE /identity/v3/users/df126d4b9ffd4593871706005b0cb346 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:42.418846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:42.419152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:42.419434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:42.425448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:42.426860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:42.427160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:42.427442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] PATH_INFO: `/v3/users/229327b6d6c8417ba3450a9c783f993b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:42.432728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229327b6d6c8417ba3450a9c783f993b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:42.432962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:42.451959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:42.454586 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:42.502678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229327b6d6c8417ba3450a9c783f993b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.512068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229327b6d6c8417ba3450a9c783f993b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.512911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229327b6d6c8417ba3450a9c783f993b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.521305 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:42.523547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229327b6d6c8417ba3450a9c783f993b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.524761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229327b6d6c8417ba3450a9c783f993b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.534497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1072/2123] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:42.543851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:42.545207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:42.552278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1052/2124] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:42 2022] DELETE /identity/v3/users/229327b6d6c8417ba3450a9c783f993b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:42.610321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc199c8-7438-4934-904c-3b947a8270a0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:42.672925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:42.674100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:42.675111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:42.675683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:42.741856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:42.743327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:42.747540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:42.749377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:42.754195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1073/2125] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:42.764537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c510c-1b75-4b4e-a0ee-befbfe66fdd0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:42.770295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:42.771222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:42.771495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:42.771796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] PATH_INFO: `/v3/projects/b09331503efc45f99ce2a0876f084f56` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:42.773014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09331503efc45f99ce2a0876f084f56)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:42.775157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:42.829118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09331503efc45f99ce2a0876f084f56', 'request_id': 'req-c36c72be-c9f6-4578-a323-6ace5702a7f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.837386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09331503efc45f99ce2a0876f084f56', 'request_id': 'req-c36c72be-c9f6-4578-a323-6ace5702a7f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.844095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09331503efc45f99ce2a0876f084f56', 'request_id': 'req-c36c72be-c9f6-4578-a323-6ace5702a7f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.855033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] The token cache is being invalidate because project b09331503efc45f99ce2a0876f084f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:42.855324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.855979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:42.857851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1053/2126] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:42 2022] DELETE /identity/v3/projects/b09331503efc45f99ce2a0876f084f56 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:42.862719 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:42.872869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bf6c6-a751-47ee-a202-182b36f79ad9 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:42.950472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:42.951862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:42.952301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:42.952720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] PATH_INFO: `/v3/users/8367ec81c41e4411be8341efc4590be0` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:42.954646 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8367ec81c41e4411be8341efc4590be0)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:42.957818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:42.964771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.020234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8367ec81c41e4411be8341efc4590be0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.032000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8367ec81c41e4411be8341efc4590be0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.040335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8367ec81c41e4411be8341efc4590be0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.040987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8367ec81c41e4411be8341efc4590be0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.051388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.053318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.055181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-afc4f6cb-acff-40ea-b71c-aae2ecf750ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8367ec81c41e4411be8341efc4590be0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.065106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1074/2127] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:42 2022] DELETE /identity/v3/users/8367ec81c41e4411be8341efc4590be0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:43.070666 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c72be-c9f6-4578-a323-6ace5702a7f3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.091047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.147246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.148129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.148410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.148689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] PATH_INFO: `/v3/projects/45473d61071b4ca991879ef0df1eacb6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.150116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=45473d61071b4ca991879ef0df1eacb6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.152047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.204766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45473d61071b4ca991879ef0df1eacb6', 'request_id': 'req-066478e9-01ce-4383-80e5-4777a78342cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.213740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45473d61071b4ca991879ef0df1eacb6', 'request_id': 'req-066478e9-01ce-4383-80e5-4777a78342cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.221764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45473d61071b4ca991879ef0df1eacb6', 'request_id': 'req-066478e9-01ce-4383-80e5-4777a78342cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.237184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] The token cache is being invalidate because project 45473d61071b4ca991879ef0df1eacb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:43.237482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.238368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.243190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1054/2128] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:43 2022] DELETE /identity/v3/projects/45473d61071b4ca991879ef0df1eacb6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:43.245557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea8023-7fe6-4d78-8802-be3bad52dd86 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.246069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea8023-7fe6-4d78-8802-be3bad52dd86 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.246261 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea8023-7fe6-4d78-8802-be3bad52dd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.258526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.260349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.266148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d7ea8023-7fe6-4d78-8802-be3bad52dd86 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:43.267435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d7ea8023-7fe6-4d78-8802-be3bad52dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.350258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1075/2129] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:43.360013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.360347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.360575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.361561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066478e9-01ce-4383-80e5-4777a78342cf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.366930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.367802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.368978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.368978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] PATH_INFO: `/v3/projects/d47e4b617a164201a8b1f5587a1a7a5a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.369544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47e4b617a164201a8b1f5587a1a7a5a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.371508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.379783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:43.380999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.389027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1076/2130] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:43.393683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.402722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959ac32-3710-49e6-b3db-0a0ce750a790 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.407406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.408171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.408506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.408749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.409479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:43.409824 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.411433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.422701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47e4b617a164201a8b1f5587a1a7a5a', 'request_id': 'req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.424972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.428438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47e4b617a164201a8b1f5587a1a7a5a', 'request_id': 'req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.432248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1077/2131] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:43.435386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47e4b617a164201a8b1f5587a1a7a5a', 'request_id': 'req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.436602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.446607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5df7-ce86-405b-b73f-cf5737fb919d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.446873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] The token cache is being invalidate because project d47e4b617a164201a8b1f5587a1a7a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:43.447136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.447821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bd5d8e-6c24-4fe1-b5be-cac0305c7cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:43.449410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1055/2132] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:43 2022] DELETE /identity/v3/projects/d47e4b617a164201a8b1f5587a1a7a5a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:43.454167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccfdc6-8f87-441e-9b7d-6f83999e37bc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.454459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccfdc6-8f87-441e-9b7d-6f83999e37bc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.454740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccfdc6-8f87-441e-9b7d-6f83999e37bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.474341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1dccfdc6-8f87-441e-9b7d-6f83999e37bc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:43.475628 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1dccfdc6-8f87-441e-9b7d-6f83999e37bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.515791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.516611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.516970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.517319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.518170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.520156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.529039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.543254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1056/2133] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:43.551412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.551795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.552191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.558936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1078/2134] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:43.565478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.567429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.575320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:43.576512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.651601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321edbdd-473b-4b14-a1d1-f80f46184993 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.659386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.660303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.661639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1057/2135] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:43.662067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.662458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.663201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.664767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.665244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.675493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533084e-3f24-4298-bbf8-24d191617d59 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.681992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.682274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.682541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.682812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.683597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:43.683913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.685539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.687756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1079/2136] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:43.691871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.700478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1058/2137] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:57:43.701684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea86f9-05b7-4bd2-a0bf-142816334f51 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.705285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.706936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.707609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.708153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.708153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.708967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.710732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.717369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614e40d-8bab-4b64-be1c-668938816926 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.725792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1080/2138] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:43.725948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.725948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.725948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.725948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.726681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.726862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.728657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.744954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406a2f5-4471-4fd3-aa3c-1b3fe5a698dc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.750607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.751292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.751578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.751857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.752597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.754367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.757910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1059/2139] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:43.762001 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.766141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1081/2140] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:43.770056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.780430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e464c61-a1a4-425c-8018-d354671a8fda admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.813975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.829522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8cc61-fda6-4efb-8a45-3ae592eb485c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.834388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.835067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.835355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.835635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.836384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.838368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.842371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cac1a-eb70-4be8-b5bb-f2370fe7e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.843258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cac1a-eb70-4be8-b5bb-f2370fe7e5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.843641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cac1a-eb70-4be8-b5bb-f2370fe7e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.843941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cac1a-eb70-4be8-b5bb-f2370fe7e5ad admin admin] PATH_INFO: `/v3/projects/b8d5219ab6684d7abf5f010190db7ea6/users/dca4774b3f7040b5a3eb29dd5dd57a69/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.862478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1060/2141] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:43.863112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cac1a-eb70-4be8-b5bb-f2370fe7e5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d5219ab6684d7abf5f010190db7ea6, user_id=dca4774b3f7040b5a3eb29dd5dd57a69, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.863879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.864774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cac1a-eb70-4be8-b5bb-f2370fe7e5ad admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.877295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2437ec-a2ee-429c-94f5-7960d082f6b4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.880356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1082/2142] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:43 2022] PUT /identity/v3/projects/b8d5219ab6684d7abf5f010190db7ea6/users/dca4774b3f7040b5a3eb29dd5dd57a69/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:43.890563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.891154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.891309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.917048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] MFA Rules not processed for user `dca4774b3f7040b5a3eb29dd5dd57a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:43.918585 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:43.936144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.936818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.937105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.937385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.938247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.939865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.947626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.952969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1061/2143] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:43.955073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.972227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e450e28-020a-48b6-a414-0ea514330e39 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:43.977267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:43.978006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:43.978288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:43.978570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:43.979310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:43.980934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:43.996107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1062/2144] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:43.996255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1083/2145] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:43.996979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:43.999968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.007890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7bff7-069e-4036-9352-2502fbce7f4e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.010712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f28c6-7e35-4dbe-b979-f3cd426f4d4b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.012671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc5ee-8a0a-45ca-8fce-4d510d12aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.013552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc5ee-8a0a-45ca-8fce-4d510d12aa2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.013872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc5ee-8a0a-45ca-8fce-4d510d12aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.014150 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc5ee-8a0a-45ca-8fce-4d510d12aa2d admin admin] PATH_INFO: `/v3/projects/b0187e9d36054d589d85a321b1913418/users/99d63506432d45cdb94a4658ece8fb31/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.015290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.016006 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.016361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.016654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.017382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.019343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.032780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc5ee-8a0a-45ca-8fce-4d510d12aa2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0187e9d36054d589d85a321b1913418, user_id=99d63506432d45cdb94a4658ece8fb31, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.035417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc5ee-8a0a-45ca-8fce-4d510d12aa2d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.047770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1084/2146] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:43 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:44.049028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1063/2147] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:43 2022] PUT /identity/v3/projects/b0187e9d36054d589d85a321b1913418/users/99d63506432d45cdb94a4658ece8fb31/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:44.053723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.058722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.059011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.059291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.085854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] MFA Rules not processed for user `99d63506432d45cdb94a4658ece8fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:44.087315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:44.117197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8c75b-9b1c-4912-a634-82898f0828dc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.122101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.122770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.123058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.123332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.124031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.126304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.148193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1085/2148] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:44.153956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.161227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1064/2149] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:44.165863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.167141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a9d1c-449a-4024-8a5a-68783e3cb98c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.172665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.173538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.173860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.174146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.174895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.176504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.178237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709b022-5f2c-475b-88ae-9e510667005b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.187889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1086/2150] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:44.191761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.192741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.193427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.193800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.194043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.194758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.196701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.202338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5924-7bee-4ff7-a65d-921eff5e32f0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.207122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.208013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.208302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.208580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] PATH_INFO: `/v3/projects/6904532dc7964a2c9fd6e0c93857116b/users/df4ff76fdebf40b5a0613a124407599a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.226490 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1065/2151] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:44.230295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.230780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6904532dc7964a2c9fd6e0c93857116b, user_id=df4ff76fdebf40b5a0613a124407599a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.233454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.236458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:44.247956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1087/2152] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:44 2022] PUT /identity/v3/projects/6904532dc7964a2c9fd6e0c93857116b/users/df4ff76fdebf40b5a0613a124407599a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:44.252083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.313832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921cd92-6c71-4f8e-af04-e306f8193fcf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.324823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a340-8c57-4bd1-9b7e-699ad495e767 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.329727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.330392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.330681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.330962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.331802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.333414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.335621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:44.349811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1088/2153] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:44.351103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.363538 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cf474-2f9e-4c40-ae9e-745578c1a2a5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.369304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215b4dd-9595-44b8-8556-554c12c37465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.370340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215b4dd-9595-44b8-8556-554c12c37465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.370631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215b4dd-9595-44b8-8556-554c12c37465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.370974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215b4dd-9595-44b8-8556-554c12c37465 admin admin] PATH_INFO: `/v3/projects/6904532dc7964a2c9fd6e0c93857116b/users/df4ff76fdebf40b5a0613a124407599a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.374052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215b4dd-9595-44b8-8556-554c12c37465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6904532dc7964a2c9fd6e0c93857116b, user_id=df4ff76fdebf40b5a0613a124407599a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.375412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.376210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.376652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.376947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.377509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215b4dd-9595-44b8-8556-554c12c37465 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.377705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.379620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.389493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1089/2154] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:44 2022] PUT /identity/v3/projects/6904532dc7964a2c9fd6e0c93857116b/users/df4ff76fdebf40b5a0613a124407599a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:44.401228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.401527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.401820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.405381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1066/2155] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:44.409406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.419535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f31cb2-10ee-4420-ae3a-6b42b03948ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.429264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] MFA Rules not processed for user `df4ff76fdebf40b5a0613a124407599a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:44.430549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:44.482321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.483090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.483352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.483630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.484968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.486937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.497372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1067/2156] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:44.501462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.502708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1090/2157] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:44.511460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70e26-b7ff-476d-9a1f-4c17109c736c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.516097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.516850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.518571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.519012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.519410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:44.519586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.520510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.522167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.538636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1068/2158] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:44.539706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.550223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fdba8-8216-4665-a651-d1012cf77b43 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.555002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2873ce-ae84-4f83-9b1b-ab429ed4f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.555852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2873ce-ae84-4f83-9b1b-ab429ed4f03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.556242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2873ce-ae84-4f83-9b1b-ab429ed4f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.556544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2873ce-ae84-4f83-9b1b-ab429ed4f03c admin admin] PATH_INFO: `/v3/projects/95d5a9dede264dda88629c5dd91818f4/users/e8bd6f348cfa49efacc82ccc9e4c3675/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.576587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2873ce-ae84-4f83-9b1b-ab429ed4f03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d5a9dede264dda88629c5dd91818f4, user_id=e8bd6f348cfa49efacc82ccc9e4c3675, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.579912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2873ce-ae84-4f83-9b1b-ab429ed4f03c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.583204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ab666-7e6c-4c93-a20d-8a68f67fd4ca None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.603250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.603250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.603250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.603250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.603743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1069/2159] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:44 2022] PUT /identity/v3/projects/95d5a9dede264dda88629c5dd91818f4/users/e8bd6f348cfa49efacc82ccc9e4c3675/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:44.615216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.615502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.615773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.619366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.620911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.621502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:44.633441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1091/2160] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:44.645448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] MFA Rules not processed for user `e8bd6f348cfa49efacc82ccc9e4c3675`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:44.646771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:44.719442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1070/2161] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:44.723956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.736764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b216-7b5f-47d3-b6f0-1dbacb715990 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.807845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.808528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.808813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.809096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.809849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.811916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.832846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:44.840092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1092/2162] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:44.844136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.868585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688ee63-0083-4fb5-bfe5-909a86bc098e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.944901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.945588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.945907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.946222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.946918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.948844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:44.968862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1071/2163] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:44 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:44.972764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.977699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:44.985063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762bf7-00f6-41d7-9016-87620bb5190c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:44.990927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:44.991601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:44.991891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:44.992170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:44.992912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:44.994600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.007019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1093/2164] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:45.011674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.023662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a699-1f2d-42bb-b5e0-9165ed0849af admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.028499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.029419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.029726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.030010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] PATH_INFO: `/v3/projects/80be9b45a2e34ca8aa748517ae853293/users/88636819044f4b71ae7568c1f32eb679/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.044682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233efdd8-a6b5-4b36-8321-c4ff3e930435 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.046432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80be9b45a2e34ca8aa748517ae853293, user_id=88636819044f4b71ae7568c1f32eb679, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.049326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.049444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df4ff76fdebf40b5a0613a124407599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6904532dc7964a2c9fd6e0c93857116b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.050050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.050339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.050632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.051375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:45.051689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.053291 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.063152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1094/2165] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:45 2022] PUT /identity/v3/projects/80be9b45a2e34ca8aa748517ae853293/users/88636819044f4b71ae7568c1f32eb679/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:45.068538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1072/2166] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:57:45.068691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.069556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.079809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c988a-8f3d-41ff-9677-1a77e4a28ac0 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.091109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:45.131949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f666-7ef4-42cf-82db-88b58dc120a6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.136732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.137406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.137732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.138013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.138105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df4ff76fdebf40b5a0613a124407599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6904532dc7964a2c9fd6e0c93857116b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.138702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.138804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.138990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.139266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.139951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.140362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.142173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.154463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1095/2167] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:45.155684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.166817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6fe1f-ee71-4f90-a2e6-7b976c7d61a4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.170667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1073/2168] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:45 2022] POST /identity/v3/projects => generated 353 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:45.171499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f582a-e1a4-4497-b059-0b555720d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.172467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f582a-e1a4-4497-b059-0b555720d632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.172748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f582a-e1a4-4497-b059-0b555720d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.173025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f582a-e1a4-4497-b059-0b555720d632 admin admin] PATH_INFO: `/v3/projects/80be9b45a2e34ca8aa748517ae853293/users/88636819044f4b71ae7568c1f32eb679/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.175005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f582a-e1a4-4497-b059-0b555720d632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80be9b45a2e34ca8aa748517ae853293, user_id=88636819044f4b71ae7568c1f32eb679, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.175112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.177648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f582a-e1a4-4497-b059-0b555720d632 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.188679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1096/2169] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:45 2022] PUT /identity/v3/projects/80be9b45a2e34ca8aa748517ae853293/users/88636819044f4b71ae7568c1f32eb679/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:45.199345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.200156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.200156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.249790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] MFA Rules not processed for user `88636819044f4b71ae7568c1f32eb679`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:45.251312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:45.256516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93aac7-153c-4d38-9a41-9223882fe271 tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.317623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df4ff76fdebf40b5a0613a124407599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6904532dc7964a2c9fd6e0c93857116b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.318501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.318611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.318848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.319581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:45.319961 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.321573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.324000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1097/2170] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:45.336992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1074/2171] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:45.337156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.370520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.372053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:45.380873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7033-13ac-4888-b9d3-aba39066c13e tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.385535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df4ff76fdebf40b5a0613a124407599a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6904532dc7964a2c9fd6e0c93857116b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.386481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.386794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.387073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] PATH_INFO: `/v3/projects/77c9acc3f501442a8bdf55651609dac4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.388264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77c9acc3f501442a8bdf55651609dac4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.390223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.396400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279dffc-4a78-43f6-b165-13ee207624f3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.400654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.401301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.401583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.401889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.435227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:45.446854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c9acc3f501442a8bdf55651609dac4', 'request_id': 'req-7a742744-cb61-4654-8ec2-eeebf2c8021b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.455211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c9acc3f501442a8bdf55651609dac4', 'request_id': 'req-7a742744-cb61-4654-8ec2-eeebf2c8021b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.461336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.462358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c9acc3f501442a8bdf55651609dac4', 'request_id': 'req-7a742744-cb61-4654-8ec2-eeebf2c8021b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.462854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.472803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1098/2172] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:45.473885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] The token cache is being invalidate because project 77c9acc3f501442a8bdf55651609dac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:45.474191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.474885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a742744-cb61-4654-8ec2-eeebf2c8021b tempest-VolumeQuotaClassesTest-767598265 tempest-VolumeQuotaClassesTest-767598265-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.476460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1075/2173] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:45 2022] DELETE /identity/v3/projects/77c9acc3f501442a8bdf55651609dac4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:45.730577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:45.807652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e92c1-01a7-49e6-a04f-ce25a1c13cbb service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:45.864402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:45.865268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.865551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.865862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] PATH_INFO: `/v3/users/dca4774b3f7040b5a3eb29dd5dd57a69` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.867039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca4774b3f7040b5a3eb29dd5dd57a69)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:45.868971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:45.909364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:45.920805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca4774b3f7040b5a3eb29dd5dd57a69'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.928122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca4774b3f7040b5a3eb29dd5dd57a69'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.935611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca4774b3f7040b5a3eb29dd5dd57a69'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.936360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca4774b3f7040b5a3eb29dd5dd57a69'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.949912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca4774b3f7040b5a3eb29dd5dd57a69'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:45.956842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1099/2174] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:45 2022] DELETE /identity/v3/users/dca4774b3f7040b5a3eb29dd5dd57a69 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:45.961354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:45.961861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:45.961861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:45.980228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:45.981451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:46.042913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1076/2175] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:46.052672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:46.054200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:46.112546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a7492-07fc-4fd1-aee7-2c707b5dcd03 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:46.116399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:46.116980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:46.117267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:46.117548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:46.127276 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:46.128732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:46.138788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1100/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:46.422788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:46.424289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:46.438302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcfc31-78f8-48f6-a927-d55d2d84cb14 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:46.444936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:46.445979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:46.446097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:46.446406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] PATH_INFO: `/v3/projects/b8d5219ab6684d7abf5f010190db7ea6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:46.448192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d5219ab6684d7abf5f010190db7ea6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:46.450134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:46.498328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d5219ab6684d7abf5f010190db7ea6', 'request_id': 'req-03d3f963-f625-4c3b-804a-987854eddc63'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.506809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d5219ab6684d7abf5f010190db7ea6', 'request_id': 'req-03d3f963-f625-4c3b-804a-987854eddc63'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.513615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d5219ab6684d7abf5f010190db7ea6', 'request_id': 'req-03d3f963-f625-4c3b-804a-987854eddc63'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.524782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] The token cache is being invalidate because project b8d5219ab6684d7abf5f010190db7ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:46.525075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.525738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.528317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1077/2177] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:46 2022] DELETE /identity/v3/projects/b8d5219ab6684d7abf5f010190db7ea6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:46.533448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:46.543309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b443cad-beee-45b6-8092-788f39518435 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:46.605207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:46.606128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:46.606942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:46.606942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] PATH_INFO: `/v3/users/df4ff76fdebf40b5a0613a124407599a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:46.607974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4ff76fdebf40b5a0613a124407599a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:46.610344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:46.670409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4ff76fdebf40b5a0613a124407599a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.678786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4ff76fdebf40b5a0613a124407599a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.683022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:46.690872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4ff76fdebf40b5a0613a124407599a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.691891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4ff76fdebf40b5a0613a124407599a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.708798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4ff76fdebf40b5a0613a124407599a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:46.723605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1101/2178] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:46 2022] DELETE /identity/v3/users/df4ff76fdebf40b5a0613a124407599a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:47.006846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.008387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.010087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.011548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.066224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:47.070231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f963-f625-4c3b-804a-987854eddc63 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.086464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85feb3-0e39-4b3e-b02e-307950f0a234 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.091078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.091948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.092233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.092672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] PATH_INFO: `/v3/projects/6904532dc7964a2c9fd6e0c93857116b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.093732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6904532dc7964a2c9fd6e0c93857116b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.096509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.127209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.128164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.128587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.129137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.131316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.150919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6904532dc7964a2c9fd6e0c93857116b', 'request_id': 'req-d3a26f28-de2f-46ba-a054-31efa880734c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:47.160002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6904532dc7964a2c9fd6e0c93857116b', 'request_id': 'req-d3a26f28-de2f-46ba-a054-31efa880734c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:47.169084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6904532dc7964a2c9fd6e0c93857116b', 'request_id': 'req-d3a26f28-de2f-46ba-a054-31efa880734c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:47.183659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] The token cache is being invalidate because project 6904532dc7964a2c9fd6e0c93857116b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:47.184000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:47.184819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d3a26f28-de2f-46ba-a054-31efa880734c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:47.187008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1102/2179] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:47 2022] DELETE /identity/v3/projects/6904532dc7964a2c9fd6e0c93857116b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:47.192487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.192956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.193241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.202854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.204353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1346af-14bd-4496-8beb-0a5473a787d3 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.216909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:47.216909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.224304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1078/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:47.297832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1103/2181] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:47.305527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.305933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.306285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.325738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:47.326983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.338074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1079/2182] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:47.341937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.349393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:47.354015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a88ef-8fbc-4f33-adac-3205f8a81e0c None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.363700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.363700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.363700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.363700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.364140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:47.364140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.364140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.378126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1104/2183] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:47.382383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.391795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428e986-210a-420f-bfbe-b9c437b135ab None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.396967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.397706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.398066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.398316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.399026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.401032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.428991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1080/2184] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:47.433392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.443570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd059-903f-4d84-ad6a-76b608956aaf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.501670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.502484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.502843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.503155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.503914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.506122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.531368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1105/2185] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:47.532729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.543080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bfabf-02cc-49c3-97e2-8e4e20d052ce admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.548179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.548851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.549139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.549413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.550173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.551896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.562798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1081/2186] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:47.570463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.583767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb34cc4-65d1-4abb-b1bb-f6a6f4351f47 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.589752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4305f-954f-43f1-949c-5da7ac3555f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.590461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4305f-954f-43f1-949c-5da7ac3555f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.590754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4305f-954f-43f1-949c-5da7ac3555f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.591039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4305f-954f-43f1-949c-5da7ac3555f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.592041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4305f-954f-43f1-949c-5da7ac3555f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.593732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4305f-954f-43f1-949c-5da7ac3555f5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.606401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1106/2187] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:47.611376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.622520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11721-ea71-48f1-b796-36af023026d5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.628206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.629382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.629767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.630146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] PATH_INFO: `/v3/projects/01f4b5ff620746daa7097c0ddee1aff7/users/6ae32c6ee548443db8c762248b678876/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.648634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f4b5ff620746daa7097c0ddee1aff7, user_id=6ae32c6ee548443db8c762248b678876, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.651452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.667505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1082/2188] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:47 2022] PUT /identity/v3/projects/01f4b5ff620746daa7097c0ddee1aff7/users/6ae32c6ee548443db8c762248b678876/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:47.677812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.678107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.678391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.706316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] MFA Rules not processed for user `6ae32c6ee548443db8c762248b678876`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:47.707578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.797277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1107/2189] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:47.801822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.808126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.809520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.869444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:47.874820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51732b8-6ba8-41cf-a174-10a8124b5d90 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.876195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8280c-ac36-46e8-8f51-c4576d17a7ad None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.880532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.881219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.881485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.881624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.881812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.882191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.882484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.882982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.883604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:47.883711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.885692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.897184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:47.913560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1083/2190] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:47.917296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:47.954197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.955736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:47.969036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1108/2191] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:47.982075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9d88c-be9c-4c5b-8176-4a9114d3bbd5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:47.987464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:47.988148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:47.988432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:47.988777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:47.989487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:47.991480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.017429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1084/2192] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:47 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:48.021945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.037932 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719f01-8e7f-469d-9a60-7a52c3d7f4e4 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.042756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.043433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.043717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.044011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.044755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.046411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.057965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1109/2193] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:48.061875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.072279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59fa67-e3ba-4d29-a851-2c794c10ff04 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.077688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacac7c7-df32-4cb4-a029-093513cbd950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.077688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac7c7-df32-4cb4-a029-093513cbd950 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.077892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac7c7-df32-4cb4-a029-093513cbd950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.078199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac7c7-df32-4cb4-a029-093513cbd950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.079115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacac7c7-df32-4cb4-a029-093513cbd950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.080726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacac7c7-df32-4cb4-a029-093513cbd950 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.091742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1085/2194] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:48.096804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.112778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271580dd-e462-4e3f-95bc-30ef923cb754 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.120546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.121778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.122147 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.122521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] PATH_INFO: `/v3/projects/ed549db841244a70967bbb8a2ddf8f88/users/8f0a6f3a084348f99e297895e96ff679/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.140765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed549db841244a70967bbb8a2ddf8f88, user_id=8f0a6f3a084348f99e297895e96ff679, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.143559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.159767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1110/2195] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:48 2022] PUT /identity/v3/projects/ed549db841244a70967bbb8a2ddf8f88/users/8f0a6f3a084348f99e297895e96ff679/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:48.173635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.173635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.173635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.210505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] MFA Rules not processed for user `8f0a6f3a084348f99e297895e96ff679`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:48.211811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:48.292464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1086/2196] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:48.297419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.366151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a04d9c-b265-4821-906b-b118827092be admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.371236 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.372061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.372154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.372430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.373249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.375207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.404634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1111/2197] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:48 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:48.408885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.421282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae639e0-85cb-4786-a87e-4c2f49f476e4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.472237 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:48.486231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.486925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.487217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.487499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.488211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.490192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.513144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1087/2198] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:48 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:48.517461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.528090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832894f0-597c-4e1b-95c6-71b353d0fc1e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.533005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.533696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.533981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.534257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.534998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.536607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.547322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1112/2199] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:48.551612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.561838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beeb92-af1e-4c88-b044-f9c1535a9270 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.568261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.569131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.569417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.569714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] PATH_INFO: `/v3/projects/484d63e83f7d428196468a720f4c7c38/users/2b095c93f454484b808e73599ccfcb45/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.588919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484d63e83f7d428196468a720f4c7c38, user_id=2b095c93f454484b808e73599ccfcb45, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.591700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.607588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1088/2200] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:48 2022] PUT /identity/v3/projects/484d63e83f7d428196468a720f4c7c38/users/2b095c93f454484b808e73599ccfcb45/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:48.612453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.623130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6fd7-2d1d-4232-ade0-f3d0ced6db39 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.669757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:48.682519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4e3d-1531-4a1a-831d-4081fb6e1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.683185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4e3d-1531-4a1a-831d-4081fb6e1180 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.683467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4e3d-1531-4a1a-831d-4081fb6e1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.683745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4e3d-1531-4a1a-831d-4081fb6e1180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.684481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e4e3d-1531-4a1a-831d-4081fb6e1180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.686155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e4e3d-1531-4a1a-831d-4081fb6e1180 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.696428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1113/2201] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:48.700821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.711287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16da694-8b55-4ee6-8eeb-23b0f52d53c9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.716179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.717060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.717338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.717647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] PATH_INFO: `/v3/projects/484d63e83f7d428196468a720f4c7c38/users/2b095c93f454484b808e73599ccfcb45/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.719817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484d63e83f7d428196468a720f4c7c38, user_id=2b095c93f454484b808e73599ccfcb45, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.722585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.733273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1089/2202] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:48 2022] PUT /identity/v3/projects/484d63e83f7d428196468a720f4c7c38/users/2b095c93f454484b808e73599ccfcb45/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:48.743940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.744232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.744518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.772477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] MFA Rules not processed for user `2b095c93f454484b808e73599ccfcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:48.773659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:48.855070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1114/2203] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:48.867015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:48.868749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:48.928157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db3138-e2a6-4b40-8ee9-8586f18831a2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:48.932083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:48.932819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:48.933104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:48.933382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:48.942893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:48.944357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:48.953945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1090/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:48.996109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:49.007546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfe6cc-919b-4f0d-b935-d540d61e90ad None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:49.012121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:49.012806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:49.013153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:49.014148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:49.085132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:49.086860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:49.098399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1115/2205] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:52.005202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.007284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.085193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b70dd2-4099-4e19-83a8-570f80f53dc0 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:52.089814 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:52.090796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.091090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.091368 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] PATH_INFO: `/v3/users/99d63506432d45cdb94a4658ece8fb31` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.092709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d63506432d45cdb94a4658ece8fb31)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:52.094783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:52.128866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.140635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1421192-8e45-4fef-863b-be22efda949d service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:52.144681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:52.145392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:52.146287 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.146566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.146839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] PATH_INFO: `/v3/users/6ae32c6ee548443db8c762248b678876` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.146972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d63506432d45cdb94a4658ece8fb31'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.148070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae32c6ee548443db8c762248b678876)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:52.150070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:52.156564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d63506432d45cdb94a4658ece8fb31'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.157327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d63506432d45cdb94a4658ece8fb31'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.167604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d63506432d45cdb94a4658ece8fb31'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.168225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6f934d8-b82e-4803-a823-d3f14f8acdf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d63506432d45cdb94a4658ece8fb31'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.186502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1091/2206] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:52 2022] DELETE /identity/v3/users/99d63506432d45cdb94a4658ece8fb31 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:52.191071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.191434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.191776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.199996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae32c6ee548443db8c762248b678876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.208231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae32c6ee548443db8c762248b678876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.209491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:52.210721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.216708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae32c6ee548443db8c762248b678876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.217355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae32c6ee548443db8c762248b678876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.218713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:52.232551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-7bd522a6-ed93-46e9-a1da-28b7f7497a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae32c6ee548443db8c762248b678876'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.239199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1116/2207] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:52 2022] DELETE /identity/v3/users/6ae32c6ee548443db8c762248b678876 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:52.243649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.243940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.244222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.260771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:52.261994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.274412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1092/2208] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:52.284392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.285861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.324131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1117/2209] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:52.334920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.336766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.358501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d29fe-db0a-4221-a6ca-9888afe33713 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:52.398703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5588f7-d439-44d1-9180-044fcbddcca4 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:52.403206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:52.404007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.404363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.404702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.410928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:52.411734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.412112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.412451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.416055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:52.417593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:52.422296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:52.423914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:52.427521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1118/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:52.433915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1093/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:52.811450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.813026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.829962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.831669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.844248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab1ffc-30f9-4c67-a864-49aabf72cd8c service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:52.850210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:52.850366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b0ff6-2446-4d7f-b357-387a328ecb32 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:52.851500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.851902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.852216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] PATH_INFO: `/v3/projects/b0187e9d36054d589d85a321b1913418` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.853671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0187e9d36054d589d85a321b1913418)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:52.855718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:52.855837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:52.856700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:52.856985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:52.857361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] PATH_INFO: `/v3/projects/01f4b5ff620746daa7097c0ddee1aff7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:52.859189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f4b5ff620746daa7097c0ddee1aff7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:52.861520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:52.879787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:52.910949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0187e9d36054d589d85a321b1913418', 'request_id': 'req-2e114fd2-27df-469f-aeb1-3f31fb0027f7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.915090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f4b5ff620746daa7097c0ddee1aff7', 'request_id': 'req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.919118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0187e9d36054d589d85a321b1913418', 'request_id': 'req-2e114fd2-27df-469f-aeb1-3f31fb0027f7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.927101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f4b5ff620746daa7097c0ddee1aff7', 'request_id': 'req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.930775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0187e9d36054d589d85a321b1913418', 'request_id': 'req-2e114fd2-27df-469f-aeb1-3f31fb0027f7'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.938221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f4b5ff620746daa7097c0ddee1aff7', 'request_id': 'req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.943348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] The token cache is being invalidate because project b0187e9d36054d589d85a321b1913418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:52.943648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.944320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.946126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1119/2212] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:52 2022] DELETE /identity/v3/projects/b0187e9d36054d589d85a321b1913418 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:52.949755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.950479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] The token cache is being invalidate because project 01f4b5ff620746daa7097c0ddee1aff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:52.950912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.951042 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.951579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:52.953345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1094/2213] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:52 2022] DELETE /identity/v3/projects/01f4b5ff620746daa7097c0ddee1aff7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:52.957217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:52.958672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:52.961174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:53.025244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114fd2-27df-469f-aeb1-3f31fb0027f7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:53.031929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:53.033020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:53.033464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:53.033787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] PATH_INFO: `/v3/users/e8bd6f348cfa49efacc82ccc9e4c3675` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:53.034478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5e62-98b2-4aad-a2cd-d9252d234f0f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:53.035129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bd6f348cfa49efacc82ccc9e4c3675)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:53.037072 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:53.039386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:53.040588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:53.040588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:53.041018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] PATH_INFO: `/v3/users/8f0a6f3a084348f99e297895e96ff679` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:53.042484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0a6f3a084348f99e297895e96ff679)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:53.044710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:53.119689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bd6f348cfa49efacc82ccc9e4c3675'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.122764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0a6f3a084348f99e297895e96ff679'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.128822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bd6f348cfa49efacc82ccc9e4c3675'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.132696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0a6f3a084348f99e297895e96ff679'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.133675 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0a6f3a084348f99e297895e96ff679'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.139554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bd6f348cfa49efacc82ccc9e4c3675'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.140318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bd6f348cfa49efacc82ccc9e4c3675'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.144122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0a6f3a084348f99e297895e96ff679'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.145187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0a6f3a084348f99e297895e96ff679'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.176146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bd6f348cfa49efacc82ccc9e4c3675'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.186553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1120/2214] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:52 2022] DELETE /identity/v3/users/e8bd6f348cfa49efacc82ccc9e4c3675 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:53.194793 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1095/2215] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:52 2022] DELETE /identity/v3/users/8f0a6f3a084348f99e297895e96ff679 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:53.586883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:53.588812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:53.630718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:53.632222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:53.678693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d6246-db0b-4dc4-8c9e-03e5b2992084 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:53.680336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:53.713229 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:53.723699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1659da-f163-436c-ae56-07a5d05b9a0f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:53.728969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:53.729892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:53.730186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:53.730548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] PATH_INFO: `/v3/projects/ed549db841244a70967bbb8a2ddf8f88` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:53.731826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed549db841244a70967bbb8a2ddf8f88)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:53.734129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:53.742126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:53.743040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:53.743320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:53.743595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] PATH_INFO: `/v3/projects/95d5a9dede264dda88629c5dd91818f4` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:53.744889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d5a9dede264dda88629c5dd91818f4)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:53.746863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:53.780294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed549db841244a70967bbb8a2ddf8f88', 'request_id': 'req-1eada534-0d2e-45cc-8fa1-99fda433d493'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.787651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed549db841244a70967bbb8a2ddf8f88', 'request_id': 'req-1eada534-0d2e-45cc-8fa1-99fda433d493'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.793963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed549db841244a70967bbb8a2ddf8f88', 'request_id': 'req-1eada534-0d2e-45cc-8fa1-99fda433d493'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.798181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d5a9dede264dda88629c5dd91818f4', 'request_id': 'req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.805282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] The token cache is being invalidate because project ed549db841244a70967bbb8a2ddf8f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:53.805518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.806227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.806568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d5a9dede264dda88629c5dd91818f4', 'request_id': 'req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.807760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1096/2216] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:53 2022] DELETE /identity/v3/projects/ed549db841244a70967bbb8a2ddf8f88 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:53.811570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:53.812902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:53.813622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d5a9dede264dda88629c5dd91818f4', 'request_id': 'req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.824616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] The token cache is being invalidate because project 95d5a9dede264dda88629c5dd91818f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:53.824912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.825747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.827790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1121/2217] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:53 2022] DELETE /identity/v3/projects/95d5a9dede264dda88629c5dd91818f4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:53.831672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:53.833438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:53.899081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eada534-0d2e-45cc-8fa1-99fda433d493 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:53.905200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:53.906122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:53.906406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:53.906683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] PATH_INFO: `/v3/users/2b095c93f454484b808e73599ccfcb45` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:53.907488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b9572-b7d2-4e6a-8ced-0ea4a23151b6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:53.908098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b095c93f454484b808e73599ccfcb45)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:53.910107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:53.912347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:53.913225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:53.913512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:53.913833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] PATH_INFO: `/v3/users/88636819044f4b71ae7568c1f32eb679` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:53.915051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88636819044f4b71ae7568c1f32eb679)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:53.916957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:53.961639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b095c93f454484b808e73599ccfcb45'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.964364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88636819044f4b71ae7568c1f32eb679'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.969466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b095c93f454484b808e73599ccfcb45'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.970495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b095c93f454484b808e73599ccfcb45'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.972315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:53.972470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88636819044f4b71ae7568c1f32eb679'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.979862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b095c93f454484b808e73599ccfcb45'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.980507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88636819044f4b71ae7568c1f32eb679'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.980796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b095c93f454484b808e73599ccfcb45'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.981567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88636819044f4b71ae7568c1f32eb679'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:53.984073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:54.001038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1097/2218] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:53 2022] DELETE /identity/v3/users/2b095c93f454484b808e73599ccfcb45 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:54.001713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88636819044f4b71ae7568c1f32eb679'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.008625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1122/2219] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:53 2022] DELETE /identity/v3/users/88636819044f4b71ae7568c1f32eb679 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:54.414633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.416978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:54.430662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.432182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:54.540406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f687600-6a52-4bcf-a733-679e53690933 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:54.546513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:54.547722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.547722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.548006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] PATH_INFO: `/v3/projects/80be9b45a2e34ca8aa748517ae853293` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.550272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=80be9b45a2e34ca8aa748517ae853293)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:54.551332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5037-ad61-415d-abb8-78fc4b06a72a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:54.552509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:54.557506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:54.559023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.559335 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.559581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] PATH_INFO: `/v3/projects/484d63e83f7d428196468a720f4c7c38` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.561192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=484d63e83f7d428196468a720f4c7c38)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:54.563841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:54.615172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484d63e83f7d428196468a720f4c7c38', 'request_id': 'req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.624454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484d63e83f7d428196468a720f4c7c38', 'request_id': 'req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.624740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80be9b45a2e34ca8aa748517ae853293', 'request_id': 'req-fab5f613-0edf-42a5-b1a8-e14bc5406fed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.633583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80be9b45a2e34ca8aa748517ae853293', 'request_id': 'req-fab5f613-0edf-42a5-b1a8-e14bc5406fed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.635010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484d63e83f7d428196468a720f4c7c38', 'request_id': 'req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.640927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80be9b45a2e34ca8aa748517ae853293', 'request_id': 'req-fab5f613-0edf-42a5-b1a8-e14bc5406fed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.647502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] The token cache is being invalidate because project 484d63e83f7d428196468a720f4c7c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:54.647797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.648445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-fd066835-ac00-44e9-b5b9-2b8b13a4c7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.650537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1123/2220] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:54 2022] DELETE /identity/v3/projects/484d63e83f7d428196468a720f4c7c38 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:54.652625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] The token cache is being invalidate because project 80be9b45a2e34ca8aa748517ae853293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:54.653006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.653869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fab5f613-0edf-42a5-b1a8-e14bc5406fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:54.656052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51460-086b-45bc-8597-77cb755c7a02 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.656368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51460-086b-45bc-8597-77cb755c7a02 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.656644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51460-086b-45bc-8597-77cb755c7a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.658622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1098/2221] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:54 2022] DELETE /identity/v3/projects/80be9b45a2e34ca8aa748517ae853293 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:54.663364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee0ba-79ed-47bf-b16e-4ecbc1896d85 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.663723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee0ba-79ed-47bf-b16e-4ecbc1896d85 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.664104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee0ba-79ed-47bf-b16e-4ecbc1896d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.680991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-12b51460-086b-45bc-8597-77cb755c7a02 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:54.682520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-12b51460-086b-45bc-8597-77cb755c7a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:54.698773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c9aee0ba-79ed-47bf-b16e-4ecbc1896d85 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:54.700040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c9aee0ba-79ed-47bf-b16e-4ecbc1896d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:54.776266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1099/2222] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:54.783485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.783917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.784200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.797519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1124/2223] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:54.799705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.799995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.800280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.803465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:54.810488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:54.813407 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:54.821299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:54.822560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:54.824457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1100/2224] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:54.828665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.833768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1125/2225] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:54.838392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.838531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54073eb-7345-46fc-bd48-a48914ac627c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:54.843217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:54.844411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.844699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.844975 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.846818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:54.847136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:54.847682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402474-709a-4287-a1f5-41709cc332a0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:54.848777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:54.852482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:54.853143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.853430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.853747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.854481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:54.854793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:54.856404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:54.858102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:54.863750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1101/2226] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:54.868302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.877578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1126/2227] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:57:54.878924 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.881377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94618fce-bd21-4139-bc90-8759d382e756 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:54.888575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:54.889007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde874-3f20-4de4-acd3-6a1ea3da18be admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:54.889439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.889765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.890153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.891508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:54.893867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:54.894007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:54.894522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:54.894809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:54.895136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:54.895782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:54.897699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:54.923638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1102/2228] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:54.928165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:54.929364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1127/2229] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:54.934568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.001192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760c717-d8de-4183-bf29-b52c54d57195 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.007299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.008048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.008403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.008753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.009582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.011418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaa177-15b4-40d0-808f-01327d3a4b34 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.011796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.016563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.017370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.017707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.017961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.018638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.020600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.038806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1103/2230] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:55.041897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.055973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1128/2231] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:54 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:55.059298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781ef11-74c0-431e-9567-97f45f25ff56 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.061653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.064937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.065740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.066098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.066445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.067470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.069161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.078175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e1ab-641d-4b1b-90b9-7a0aa5163252 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.083312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1104/2232] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:55.085002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.085714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.086212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.086355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.087289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.087473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.090539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.100588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b89df-fc37-45a7-88da-422d752e0b98 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.107694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1129/2233] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:55.108395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.109510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.109921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.110297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.111863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.113241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.113440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.123792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45eae-f242-4878-9daa-df90c875fa6f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.125648 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1105/2234] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:55.129637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.129807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.130151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.130442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.130830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.131709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.133711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.139774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe237b4-bbbc-42cc-806a-036482765671 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.144964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395cbf-83eb-47aa-b360-69fbdf5c4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.145970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395cbf-83eb-47aa-b360-69fbdf5c4990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.146205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395cbf-83eb-47aa-b360-69fbdf5c4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.146478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395cbf-83eb-47aa-b360-69fbdf5c4990 admin admin] PATH_INFO: `/v3/projects/3de6b1acde624b2abbce70aac82f2193/users/09451dc327ba4531ac8086a5ab50c3cf/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.148584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1130/2235] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:55.152883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.162952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d395cbf-83eb-47aa-b360-69fbdf5c4990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de6b1acde624b2abbce70aac82f2193, user_id=09451dc327ba4531ac8086a5ab50c3cf, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.164807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779924e4-3eb8-41c4-80d3-7ee18b2997fc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.165707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d395cbf-83eb-47aa-b360-69fbdf5c4990 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.169649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60a2cc-299e-428a-a67e-add0e7292b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.170530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a2cc-299e-428a-a67e-add0e7292b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.170834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a2cc-299e-428a-a67e-add0e7292b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.171085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a2cc-299e-428a-a67e-add0e7292b93 admin admin] PATH_INFO: `/v3/projects/1a040da0baf74323aabe47c9c22ad2b5/users/51e8c615499c4263b4b08fa20a6cadfb/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.178860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1106/2236] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:55 2022] PUT /identity/v3/projects/3de6b1acde624b2abbce70aac82f2193/users/09451dc327ba4531ac8086a5ab50c3cf/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:55.189372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60a2cc-299e-428a-a67e-add0e7292b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a040da0baf74323aabe47c9c22ad2b5, user_id=51e8c615499c4263b4b08fa20a6cadfb, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.189943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.190244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.190661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.192113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60a2cc-299e-428a-a67e-add0e7292b93 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.208336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1131/2237] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:55 2022] PUT /identity/v3/projects/1a040da0baf74323aabe47c9c22ad2b5/users/51e8c615499c4263b4b08fa20a6cadfb/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:55.220806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.221094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.221385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.222762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] MFA Rules not processed for user `09451dc327ba4531ac8086a5ab50c3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:55.224104 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.250185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] MFA Rules not processed for user `51e8c615499c4263b4b08fa20a6cadfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:55.251482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.278503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:55.289408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1107/2238] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:55.301804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.303299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.333404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1132/2239] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:55.338589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.344429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:55.374718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34afede-c1ea-4958-9cf3-58f6a6a74925 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.378760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.379423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.379704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.380018 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.388740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.390312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.400380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1108/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:55.411634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2d563-471a-4ee6-9e28-d0d73b978dff None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.417712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.418467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.418887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.419201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.420031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.422468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.426673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.440877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b67df-9019-43ec-b0be-85c24a770f82 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.446002 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.446924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.447206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.447569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] PATH_INFO: `/v3/users/09451dc327ba4531ac8086a5ab50c3cf` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.448820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09451dc327ba4531ac8086a5ab50c3cf)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.450846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.458858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1133/2241] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:55.463056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.506993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09451dc327ba4531ac8086a5ab50c3cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:55.515565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09451dc327ba4531ac8086a5ab50c3cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:55.516615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09451dc327ba4531ac8086a5ab50c3cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:55.526582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09451dc327ba4531ac8086a5ab50c3cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:55.527379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-009929e4-7e52-4e46-ae79-6e290e3e82f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09451dc327ba4531ac8086a5ab50c3cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:55.536211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd8ced-3b92-4dcc-bdf9-f063016c4268 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.543084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.543845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.544199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.544640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.545419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.547786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.549843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1109/2242] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:55 2022] DELETE /identity/v3/users/09451dc327ba4531ac8086a5ab50c3cf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:55.554219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.554507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.554785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.570286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1134/2243] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:55 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:55.574274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.574412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:55.575633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.575888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.587850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc241e3d-366d-4604-a51e-368eb1196977 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.637536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1110/2244] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:55.647353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.648874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.654469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.655188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.655502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.655789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.656643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.658756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.665070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:55.670216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1135/2245] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:55.674572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.685040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6c702-637b-46bc-a6ca-e285ae0ae698 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.689720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.690687 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.690893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.691178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] PATH_INFO: `/v3/projects/3dcbeb0df9b2418085961847241e7ecb/users/787b808e50f44802ab0adbd052ece9e8/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.703615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:55.707185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcbeb0df9b2418085961847241e7ecb, user_id=787b808e50f44802ab0adbd052ece9e8, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.710977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.715859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f010ab-a28e-42b0-ac77-16566d52f1ab None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.719526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.720274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.720560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.720854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.725642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1136/2246] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:55 2022] PUT /identity/v3/projects/3dcbeb0df9b2418085961847241e7ecb/users/787b808e50f44802ab0adbd052ece9e8/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:55.729369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.730494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.732113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.743856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1111/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:55.801346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d62d3-8c71-4682-b105-bb5e9536e597 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.807518 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ed112-49a5-430b-9880-ebb1be976cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.808202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ed112-49a5-430b-9880-ebb1be976cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.808504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ed112-49a5-430b-9880-ebb1be976cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.808774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ed112-49a5-430b-9880-ebb1be976cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.809527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ed112-49a5-430b-9880-ebb1be976cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.811259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ed112-49a5-430b-9880-ebb1be976cd1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.825630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1137/2248] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:57:55.830822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:55.843482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c323c-a198-4662-8f76-470337498321 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:55.849109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:55.850123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.850362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.850732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] PATH_INFO: `/v3/projects/3dcbeb0df9b2418085961847241e7ecb/users/787b808e50f44802ab0adbd052ece9e8/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.852723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcbeb0df9b2418085961847241e7ecb, user_id=787b808e50f44802ab0adbd052ece9e8, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:55.855526 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:55.868117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1112/2249] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:55 2022] PUT /identity/v3/projects/3dcbeb0df9b2418085961847241e7ecb/users/787b808e50f44802ab0adbd052ece9e8/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:55.879151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:55.879454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:55.879740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:55.913911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] MFA Rules not processed for user `787b808e50f44802ab0adbd052ece9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:55.915197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:55.988365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1138/2250] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:55.999721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.001829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.025202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.026773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.065934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8780d6-a4c6-4241-a40c-9ab30fb59c74 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.069548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.070238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.070538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.070798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.072747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.104074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a5325-2eb9-4441-a6fd-3f48c3d5cdef None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.109103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.110116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.110400 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.110696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] PATH_INFO: `/v3/projects/3de6b1acde624b2abbce70aac82f2193` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.111944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de6b1acde624b2abbce70aac82f2193)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.114317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.141024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.142628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:56.142896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9d351-3287-407e-95e9-e694e32d2f7b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.153302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1113/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:56.182461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de6b1acde624b2abbce70aac82f2193', 'request_id': 'req-57d8c74f-dde2-4149-85f0-668e25a2ab05'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:56.192952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de6b1acde624b2abbce70aac82f2193', 'request_id': 'req-57d8c74f-dde2-4149-85f0-668e25a2ab05'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:56.200268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de6b1acde624b2abbce70aac82f2193', 'request_id': 'req-57d8c74f-dde2-4149-85f0-668e25a2ab05'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:56.211911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] The token cache is being invalidate because project 3de6b1acde624b2abbce70aac82f2193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:56.212361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:56.213124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-57d8c74f-dde2-4149-85f0-668e25a2ab05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:56.214888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1139/2252] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:56 2022] DELETE /identity/v3/projects/3de6b1acde624b2abbce70aac82f2193 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:57:56.219829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.220217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.220465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.239556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:56.240754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.308304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:56.323830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1114/2253] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:56.334429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.335138 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.335608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.366173 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:56.367715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.383968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.385717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1140/2254] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:56.395810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294f858-4cd6-435e-90b3-da1e29d42b5f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.405947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.407030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.407563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.408007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.408664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:56.408980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.410987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.428012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1115/2255] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:56.430649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.461257 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6ebb-2c5c-4845-bad6-94ff02c3f57a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.467018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.468325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.468325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.468551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.469377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.472481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.506063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1141/2256] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:56 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:57:56.511187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.524222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ffbd6-b1c8-4aae-a5d5-4c3a091af3e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.621039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.621762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.622050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.622330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.623030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.624970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.660172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1116/2257] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:56 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:56.661456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.673215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb25f8-3fc2-4045-b682-638a600db325 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.678581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.678999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.679290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.679576 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.680325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.683353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.703318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1142/2258] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:56.707430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.717909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844101a9-27d8-4269-9976-6f118e406e37 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.723047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1548e6-f8ad-4564-a916-74236309dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.723718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1548e6-f8ad-4564-a916-74236309dd65 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.723995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1548e6-f8ad-4564-a916-74236309dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.724268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1548e6-f8ad-4564-a916-74236309dd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.725006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1548e6-f8ad-4564-a916-74236309dd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.726667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1548e6-f8ad-4564-a916-74236309dd65 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.740705 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1117/2259] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:56.742106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.752605 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06cb0b-72b0-4eee-9b15-72317fe85e7e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.757364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.758556 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.758714 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.759010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] PATH_INFO: `/v3/projects/28f34e7ba37b4f649bf3b7d25e70eb49/users/7a2e5c2320954fc290252b4d7b57c2f5/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.775376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f34e7ba37b4f649bf3b7d25e70eb49, user_id=7a2e5c2320954fc290252b4d7b57c2f5, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:56.778526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:56.793128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1143/2260] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:56 2022] PUT /identity/v3/projects/28f34e7ba37b4f649bf3b7d25e70eb49/users/7a2e5c2320954fc290252b4d7b57c2f5/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:56.804361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.804652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.804932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:56.841458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] MFA Rules not processed for user `7a2e5c2320954fc290252b4d7b57c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:56.842875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.922970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1118/2261] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:56.934143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:56.935913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:56.995112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d275c-bfde-4c47-9868-1567504e859a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:56.998774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4b555-440b-4eba-85d2-2a25adf49673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:56.999424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4b555-440b-4eba-85d2-2a25adf49673 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:56.999705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4b555-440b-4eba-85d2-2a25adf49673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:56.999978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4b555-440b-4eba-85d2-2a25adf49673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:57.008494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4b555-440b-4eba-85d2-2a25adf49673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:57.009968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4b555-440b-4eba-85d2-2a25adf49673 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:57.019201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1144/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:57:57.724875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:57.726720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:57.788182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:57.807606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7670e80-fbe7-4479-92e7-f955695b7613 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:57.813044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:57.814210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:57.814493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:57.814770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] PATH_INFO: `/v3/users/7386d27b716c47f09d98874d22afd5d3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:57.815982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7386d27b716c47f09d98874d22afd5d3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:57.817970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:57.870289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7386d27b716c47f09d98874d22afd5d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:57.877270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7386d27b716c47f09d98874d22afd5d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:57.877965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7386d27b716c47f09d98874d22afd5d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:57.886379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7386d27b716c47f09d98874d22afd5d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:57.886987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7386d27b716c47f09d98874d22afd5d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:57.907058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1119/2263] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:57 2022] DELETE /identity/v3/users/7386d27b716c47f09d98874d22afd5d3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:57.911788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:57.912259 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:57.912366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:57.930565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:57.931769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:57.973357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:57.998920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1145/2264] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:58.008570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.010084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:58.071232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b6e8-703d-47a5-b546-d5f3b4a6da79 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.075219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4ff8-bb6d-4050-a4e8-3a1d433f08f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.075874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4ff8-bb6d-4050-a4e8-3a1d433f08f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.076160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4ff8-bb6d-4050-a4e8-3a1d433f08f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.076438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4ff8-bb6d-4050-a4e8-3a1d433f08f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.086625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e4ff8-bb6d-4050-a4e8-3a1d433f08f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.088204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e4ff8-bb6d-4050-a4e8-3a1d433f08f1 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.098419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1120/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:58.368625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.370210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:58.385469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af477a22-dbe5-4a07-971a-2e7f206fe9cf None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.401094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.401941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe63f8-e10c-4b4c-952c-2c1dc01a3f26 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.402081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.402350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe63f8-e10c-4b4c-952c-2c1dc01a3f26 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.402461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.402627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] PATH_INFO: `/v3/projects/c9b67e3e065240a0b23f03de9ea37a64` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.402790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe63f8-e10c-4b4c-952c-2c1dc01a3f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.403852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b67e3e065240a0b23f03de9ea37a64)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.405879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.420313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dffe63f8-e10c-4b4c-952c-2c1dc01a3f26 None None] MFA Rules not processed for user `7a2e5c2320954fc290252b4d7b57c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:58.421522 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dffe63f8-e10c-4b4c-952c-2c1dc01a3f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:58.456790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b67e3e065240a0b23f03de9ea37a64', 'request_id': 'req-6c934caf-206b-4492-998d-01c7ce27bff4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.464710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b67e3e065240a0b23f03de9ea37a64', 'request_id': 'req-6c934caf-206b-4492-998d-01c7ce27bff4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.471465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b67e3e065240a0b23f03de9ea37a64', 'request_id': 'req-6c934caf-206b-4492-998d-01c7ce27bff4'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.479240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1121/2266] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:57:58.483561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] The token cache is being invalidate because project c9b67e3e065240a0b23f03de9ea37a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:58.484177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.484840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c934caf-206b-4492-998d-01c7ce27bff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.486699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1146/2267] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:58 2022] DELETE /identity/v3/projects/c9b67e3e065240a0b23f03de9ea37a64 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:58.491388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.491696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.491957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.510511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:58.511714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:58.525458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:58.579184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1122/2268] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:58.588625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938021b-4076-4e84-8645-73e993ae236a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.588962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938021b-4076-4e84-8645-73e993ae236a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.589269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938021b-4076-4e84-8645-73e993ae236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.609539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e938021b-4076-4e84-8645-73e993ae236a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:58.610841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e938021b-4076-4e84-8645-73e993ae236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:58.619356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1147/2269] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:58.623753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.633908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0859-cad3-4527-a516-07f0670b0fe2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.639103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.639770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.640056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.640355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.641122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:57:58.641431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.643156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.658932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1123/2270] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:57:58.660170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938021b-4076-4e84-8645-73e993ae236a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.669421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938021b-4076-4e84-8645-73e993ae236a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.674464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.675128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.675413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.675688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.676384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.678347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.710625 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1148/2271] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:57:58 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:58.712251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.722541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6cbf-2849-4b6f-939f-785e1620516b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.786626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.787320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.787590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.787865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.788602 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.788795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.790795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.790937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:58.808421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997992e7-abed-4b28-bc9a-91ca50cbbcad admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.815430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1124/2272] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:57:58 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:57:58.819283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.819488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.820405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.820822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.821181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] PATH_INFO: `/v3/users/51e8c615499c4263b4b08fa20a6cadfb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.822925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e8c615499c4263b4b08fa20a6cadfb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.824877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.831800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dab410-1a50-440e-a00e-bfb6a6b4904d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.837564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.838536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.838536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.838819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.839564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.841308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.859241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1125/2273] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:58.860404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.873120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e3b42-aebf-4bfd-a62e-a67661820549 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.881736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.883331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.883619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.883895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.884663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.886358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.895779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e8c615499c4263b4b08fa20a6cadfb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.901788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1126/2274] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:57:58.902820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:58.907733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e8c615499c4263b4b08fa20a6cadfb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.918547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e8c615499c4263b4b08fa20a6cadfb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.921857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374da27-a1a8-441a-be82-eadf17ffe2a5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:58.922176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e8c615499c4263b4b08fa20a6cadfb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:58.927653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1580ae5-ba45-4431-9a01-1d905c909acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:58.928582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1580ae5-ba45-4431-9a01-1d905c909acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.928874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1580ae5-ba45-4431-9a01-1d905c909acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.929231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1580ae5-ba45-4431-9a01-1d905c909acd admin admin] PATH_INFO: `/v3/projects/d706d0f681eb4455945329034f639882/users/31f0dd24872d4576abf7d6a6b2118a1e/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.948571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1580ae5-ba45-4431-9a01-1d905c909acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d706d0f681eb4455945329034f639882, user_id=31f0dd24872d4576abf7d6a6b2118a1e, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:58.951635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1580ae5-ba45-4431-9a01-1d905c909acd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:58.982272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1127/2275] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:57:58 2022] PUT /identity/v3/projects/d706d0f681eb4455945329034f639882/users/31f0dd24872d4576abf7d6a6b2118a1e/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:58.984192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:58.984495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:58.984768 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:58.991289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4dafc4f8-6bd7-40f5-a9d1-c991bb2c0ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e8c615499c4263b4b08fa20a6cadfb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.011224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1149/2276] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:58 2022] DELETE /identity/v3/users/51e8c615499c4263b4b08fa20a6cadfb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:59.015973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:59.016262 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:59.016542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:59.034420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] MFA Rules not processed for user `31f0dd24872d4576abf7d6a6b2118a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:59.036003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:59.053754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:57:59.055217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:59.062285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:59.109500 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:59.138978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1150/2277] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:59.148721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:59.153107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1128/2278] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:57:59.153232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:59.161242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:59.162701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:59.217097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441dda0-fad7-4ff3-accc-588ef0f8124e None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:59.221563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:59.222550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:59.222872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:59.223222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:59.231710 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a06a43-1096-4c4a-b226-451db67d9935 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:59.235933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:59.236696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:59.237558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:59.237558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:59.241166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:59.242761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:59.247336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:59.249387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:59.253937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1151/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:59.260730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1129/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:57:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:57:59.569522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:59.571048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:57:59.592798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1816b-0038-473d-b255-a0853ca21acf service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:59.614571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:59.616232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:59.616396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:59.616762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] PATH_INFO: `/v3/projects/1a040da0baf74323aabe47c9c22ad2b5` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:59.619975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a040da0baf74323aabe47c9c22ad2b5)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:59.622467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:59.683390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a040da0baf74323aabe47c9c22ad2b5', 'request_id': 'req-e050989b-8e51-4e4f-96b3-a8b232de25a1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.692136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a040da0baf74323aabe47c9c22ad2b5', 'request_id': 'req-e050989b-8e51-4e4f-96b3-a8b232de25a1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.699653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a040da0baf74323aabe47c9c22ad2b5', 'request_id': 'req-e050989b-8e51-4e4f-96b3-a8b232de25a1'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.712889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] The token cache is being invalidate because project 1a040da0baf74323aabe47c9c22ad2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:57:59.713583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.714818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.716450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1152/2281] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:57:59 2022] DELETE /identity/v3/projects/1a040da0baf74323aabe47c9c22ad2b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:57:59.721043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:57:59.732725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d28d0-02a4-45d5-94e1-84c476977557 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:57:59.792857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:57:59.793800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:57:59.794080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:57:59.794348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] PATH_INFO: `/v3/users/787b808e50f44802ab0adbd052ece9e8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:57:59.795647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787b808e50f44802ab0adbd052ece9e8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:57:59.797626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:57:59.848923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787b808e50f44802ab0adbd052ece9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.856021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787b808e50f44802ab0adbd052ece9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.856698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787b808e50f44802ab0adbd052ece9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.866798 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787b808e50f44802ab0adbd052ece9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.867371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-64fad58b-8f91-4bb9-8ca1-9d0942fbfe77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787b808e50f44802ab0adbd052ece9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:57:59.881935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:59.886827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1130/2282] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:57:59 2022] DELETE /identity/v3/users/787b808e50f44802ab0adbd052ece9e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:00.477996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:00.479555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:00.493223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050989b-8e51-4e4f-96b3-a8b232de25a1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:00.541838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:00.571130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:00.572040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:00.572359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:00.572662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] PATH_INFO: `/v3/projects/3dcbeb0df9b2418085961847241e7ecb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:00.573914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcbeb0df9b2418085961847241e7ecb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:00.576088 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:00.631486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcbeb0df9b2418085961847241e7ecb', 'request_id': 'req-04a09533-40c4-4b6a-94d6-9df2a3314181'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:00.639468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcbeb0df9b2418085961847241e7ecb', 'request_id': 'req-04a09533-40c4-4b6a-94d6-9df2a3314181'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:00.646521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcbeb0df9b2418085961847241e7ecb', 'request_id': 'req-04a09533-40c4-4b6a-94d6-9df2a3314181'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:00.658612 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] The token cache is being invalidate because project 3dcbeb0df9b2418085961847241e7ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:00.658856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:00.659529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-04a09533-40c4-4b6a-94d6-9df2a3314181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:00.661320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1153/2283] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:00 2022] DELETE /identity/v3/projects/3dcbeb0df9b2418085961847241e7ecb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:00.666034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:00.666515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:00.666819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:00.685929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:00.687154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:00.765256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1131/2284] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:00.773761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:00.774055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:00.774334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:00.799638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:00.800906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:00.811158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1154/2285] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:00.816481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:00.827727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5e07d-08a9-4365-a7b5-a4d52827650f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:00.835225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:00.835989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:00.836274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:00.836557 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:00.837435 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:58:00.837752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:00.839531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:00.854000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1132/2286] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:58:00.858193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:00.868692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890dad-f234-4aee-a9ea-766ef6aa4fa6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:00.874062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:00.874783 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:00.875076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:00.875527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:00.876467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:00.878623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:00.921938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1155/2287] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:58:00 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:00.923148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:00.934016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3551-bfb8-45ed-9ede-8020773aee94 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:00.992973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:00.993712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:00.993998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:00.994272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:00.995096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:00.997031 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:01.018901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1133/2288] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:58:00 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:01.022920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:01.034557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2763-f2bf-4039-afbc-9f1f4e4be7b8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:01.039699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:01.040383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:01.040671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:01.040952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:01.041729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:01.043363 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:01.055056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1156/2289] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:01.059330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:01.070883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f395eb-2dbf-47cc-89d5-4341b4b1d541 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:01.075808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdee82-1050-40c7-a72a-7718e59eee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:01.076485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdee82-1050-40c7-a72a-7718e59eee71 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:01.076774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdee82-1050-40c7-a72a-7718e59eee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:01.077067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdee82-1050-40c7-a72a-7718e59eee71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:01.077947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdee82-1050-40c7-a72a-7718e59eee71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:01.079779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdee82-1050-40c7-a72a-7718e59eee71 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:01.090434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1134/2290] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:01.094786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:01.105618 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7108-2c09-4114-8fe6-8801826d1c69 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:01.111163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:01.112112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:01.112410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:01.112648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] PATH_INFO: `/v3/projects/cbde7766d5604b38aa472230794d4edf/users/82b8d8a1f9d54f0b849ab772d2aa6a05/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:01.129898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbde7766d5604b38aa472230794d4edf, user_id=82b8d8a1f9d54f0b849ab772d2aa6a05, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:01.132561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:01.148477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1157/2291] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:58:01 2022] PUT /identity/v3/projects/cbde7766d5604b38aa472230794d4edf/users/82b8d8a1f9d54f0b849ab772d2aa6a05/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:01.161107 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:01.161637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:01.162351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:01.208383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] MFA Rules not processed for user `82b8d8a1f9d54f0b849ab772d2aa6a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:01.209581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:01.276555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:01.300960 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1135/2292] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:01.302589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:01.310201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:01.394735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec8e19-8919-4716-9e3b-02bc9ce4a632 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:01.404896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3fea0-5539-4b73-8fbb-e5a4f6fe3b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:01.405589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3fea0-5539-4b73-8fbb-e5a4f6fe3b16 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:01.405896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3fea0-5539-4b73-8fbb-e5a4f6fe3b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:01.406175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3fea0-5539-4b73-8fbb-e5a4f6fe3b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:01.418682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3fea0-5539-4b73-8fbb-e5a4f6fe3b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:01.420342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3fea0-5539-4b73-8fbb-e5a4f6fe3b16 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:01.440973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1158/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:04.549696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:04.627789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d099cf-4f62-4ff4-b854-a90b9550cce7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:04.632636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:04.633528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:04.633850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:04.634133 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] PATH_INFO: `/v3/users/82b8d8a1f9d54f0b849ab772d2aa6a05` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:04.635360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b8d8a1f9d54f0b849ab772d2aa6a05)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:04.637345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:04.689239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b8d8a1f9d54f0b849ab772d2aa6a05'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:04.696157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b8d8a1f9d54f0b849ab772d2aa6a05'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:04.696969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b8d8a1f9d54f0b849ab772d2aa6a05'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:04.706239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b8d8a1f9d54f0b849ab772d2aa6a05'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:04.706931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b8d8a1f9d54f0b849ab772d2aa6a05'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:04.726869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1136/2294] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:04 2022] DELETE /identity/v3/users/82b8d8a1f9d54f0b849ab772d2aa6a05 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:04.731460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:04.731937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:04.732023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:04.739914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:04.753238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:04.755210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:04.816669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1159/2295] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:04.827054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:04.828476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:04.887754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1491-ca3b-49c6-b6f6-71c072e62491 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:04.892549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95712342-3df7-46f0-9e07-abea8ec9ad08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:04.893206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95712342-3df7-46f0-9e07-abea8ec9ad08 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:04.893492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95712342-3df7-46f0-9e07-abea8ec9ad08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:04.893878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95712342-3df7-46f0-9e07-abea8ec9ad08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:04.904415 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95712342-3df7-46f0-9e07-abea8ec9ad08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:04.905893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95712342-3df7-46f0-9e07-abea8ec9ad08 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:04.915844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1137/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:05.196175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.197643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:05.213627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c20e-a4d2-4b20-a934-4e01e4ff3217 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.220692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.221591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.221919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.222196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] PATH_INFO: `/v3/projects/cbde7766d5604b38aa472230794d4edf` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.223510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbde7766d5604b38aa472230794d4edf)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.225626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.284499 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbde7766d5604b38aa472230794d4edf', 'request_id': 'req-05fc4542-9592-4811-bacf-48dac6e9722b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:05.294282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbde7766d5604b38aa472230794d4edf', 'request_id': 'req-05fc4542-9592-4811-bacf-48dac6e9722b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:05.305720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbde7766d5604b38aa472230794d4edf', 'request_id': 'req-05fc4542-9592-4811-bacf-48dac6e9722b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:05.315762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] The token cache is being invalidate because project cbde7766d5604b38aa472230794d4edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:05.316028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:05.316703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-05fc4542-9592-4811-bacf-48dac6e9722b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:05.318778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1160/2297] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:05 2022] DELETE /identity/v3/projects/cbde7766d5604b38aa472230794d4edf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:05.324693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.324996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.325281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.345096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:05.347161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:05.362210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:05.429627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1138/2298] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:05.437560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.437880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.438164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.458886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:05.460609 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:05.470370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1161/2299] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:05.474666 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.485143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f86ba-2d5c-48e9-b0bb-d95316a0a480 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.489935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.491006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.491006 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.491238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.492097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:58:05.492414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.494089 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.510452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1139/2300] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:58:05.511982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.522455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92295c84-8047-48f6-9e64-54bca80a6266 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.528498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.529251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.529628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.530032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.530795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.532922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.561118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1162/2301] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:05.565386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.578965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aca17-2a98-4584-8f85-da09e401c9e0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.668701 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.669517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.669837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.670118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.670816 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.672755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.695680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1140/2302] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:58:05 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:05.696815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.707847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96fcf-e42f-4f66-a5a4-4ac107725737 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.712402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.713065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.713346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.713654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.714389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.715987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.727110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1163/2303] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:58:05.731109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.741623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a9f3f-e306-412f-af79-9e8bf015fd0e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.746605 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730352c-73a0-4c99-9ae9-c9f996cdb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.747300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730352c-73a0-4c99-9ae9-c9f996cdb1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.747589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730352c-73a0-4c99-9ae9-c9f996cdb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.747869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730352c-73a0-4c99-9ae9-c9f996cdb1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.748613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730352c-73a0-4c99-9ae9-c9f996cdb1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.750292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730352c-73a0-4c99-9ae9-c9f996cdb1ad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.760762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1141/2304] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:05.765063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.775256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83814d-6456-4a0c-b7a2-87d0ec460c3a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:05.780748 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:05.781743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.782095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.782493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] PATH_INFO: `/v3/projects/d96d65c8337b4288a25dccd2a5301b39/users/6ce6bad6101b4472bc4e82e825ee7e0a/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.802645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96d65c8337b4288a25dccd2a5301b39, user_id=6ce6bad6101b4472bc4e82e825ee7e0a, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:05.806222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:05.821901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1164/2305] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:58:05 2022] PUT /identity/v3/projects/d96d65c8337b4288a25dccd2a5301b39/users/6ce6bad6101b4472bc4e82e825ee7e0a/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:05.834418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:05.834751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:05.835030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:05.864764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] MFA Rules not processed for user `6ce6bad6101b4472bc4e82e825ee7e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:05.866053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:05.942166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1142/2306] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:05.950157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:05.954123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:05.982407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:06.018099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699d9a2-50ec-41a6-8f48-1e438de16e08 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:06.023930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:06.025091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:06.025517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:06.025963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:06.037037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:06.038740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:06.047782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1165/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:08.621303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:08.636559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:08.688339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c8636-dbe9-4f7f-8c48-4cd7edef60e3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:08.693431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:08.694347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:08.694630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:08.694910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] PATH_INFO: `/v3/users/6ce6bad6101b4472bc4e82e825ee7e0a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:08.696174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce6bad6101b4472bc4e82e825ee7e0a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:08.698153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:08.745450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:08.747003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:08.763083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce6bad6101b4472bc4e82e825ee7e0a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.763280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f0b3d-ae5d-4844-ba58-b071e2297655 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:08.768200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:08.769231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:08.769519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:08.769982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] PATH_INFO: `/v3/users/74be13d0851b49e79263c4508d9fb5ff` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:08.771306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74be13d0851b49e79263c4508d9fb5ff)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:08.772268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce6bad6101b4472bc4e82e825ee7e0a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.772981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce6bad6101b4472bc4e82e825ee7e0a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.773911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:08.783795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce6bad6101b4472bc4e82e825ee7e0a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.784835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a7f00ce1-c0fc-4128-b2d5-a07e4e1a3c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce6bad6101b4472bc4e82e825ee7e0a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.806362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1143/2308] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:08 2022] DELETE /identity/v3/users/6ce6bad6101b4472bc4e82e825ee7e0a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:08.811449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:08.811770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:08.812065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:08.827239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74be13d0851b49e79263c4508d9fb5ff'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.834197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:08.835626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:08.840194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74be13d0851b49e79263c4508d9fb5ff'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.848683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74be13d0851b49e79263c4508d9fb5ff'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.849390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74be13d0851b49e79263c4508d9fb5ff'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.866033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-999fcbc1-70be-4420-88b9-9c74b6b3b4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74be13d0851b49e79263c4508d9fb5ff'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:08.873267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1166/2309] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:08 2022] DELETE /identity/v3/users/74be13d0851b49e79263c4508d9fb5ff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:08.878449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:08.878734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:08.879141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:08.902303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:08.904290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:08.920915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1144/2310] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:08.938454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:08.940630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:08.972463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1167/2311] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:08.982264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:08.984357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:08.999550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:09.033568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19bed-9985-43d6-9c76-a721d4ea63c1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:09.037869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:09.056220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97f7f9-7877-4004-a966-cbca8ce74ea7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:09.060479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:09.061144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.061427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.061756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.080874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:09.082428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:09.093185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1168/2312] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:58:09.098075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba3e82-2491-4cff-b68e-89dcf8092c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:09.098741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3e82-2491-4cff-b68e-89dcf8092c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.099027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3e82-2491-4cff-b68e-89dcf8092c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.099309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3e82-2491-4cff-b68e-89dcf8092c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.110762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba3e82-2491-4cff-b68e-89dcf8092c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:09.112409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba3e82-2491-4cff-b68e-89dcf8092c16 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:09.125384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1145/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:09.482001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:09.484206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:09.498974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf432fd-e61f-4b58-8e90-f26dc090487d service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:09.503764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:09.504674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.504964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.505241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] PATH_INFO: `/v3/users/31f0dd24872d4576abf7d6a6b2118a1e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.506494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f0dd24872d4576abf7d6a6b2118a1e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:09.508445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:09.557698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f0dd24872d4576abf7d6a6b2118a1e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.567556 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f0dd24872d4576abf7d6a6b2118a1e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.576210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f0dd24872d4576abf7d6a6b2118a1e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.577199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f0dd24872d4576abf7d6a6b2118a1e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.610298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f0dd24872d4576abf7d6a6b2118a1e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.626947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1169/2314] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:09 2022] DELETE /identity/v3/users/31f0dd24872d4576abf7d6a6b2118a1e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:09.631381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.631995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.631995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.654448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:09.656003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:09.740979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1146/2315] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:09.749298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:09.751506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:09.770633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:09.772166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:09.798616 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41a626-90fc-4115-a3dc-f9d14a95954d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:09.806817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:09.808888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.809544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.809828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] PATH_INFO: `/v3/projects/1240c431367b4578b62ec6f485e96531` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.814035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1240c431367b4578b62ec6f485e96531)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:09.814035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:09.826811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32392-2f97-462b-beca-33bdefb1efc1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:09.830955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:09.831614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.831896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.832319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.842329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:09.843866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:09.855027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1170/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:09.855942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:09.857270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:09.871350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049ac84-bfe2-44c0-b1a5-06c78e23a1ad service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:09.873048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1240c431367b4578b62ec6f485e96531', 'request_id': 'req-40e0bf10-d34f-47bb-972e-b31c0ec14eee'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.882242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1240c431367b4578b62ec6f485e96531', 'request_id': 'req-40e0bf10-d34f-47bb-972e-b31c0ec14eee'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.890029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1240c431367b4578b62ec6f485e96531', 'request_id': 'req-40e0bf10-d34f-47bb-972e-b31c0ec14eee'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.902163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] The token cache is being invalidate because project 1240c431367b4578b62ec6f485e96531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:09.902677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.903252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-40e0bf10-d34f-47bb-972e-b31c0ec14eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:09.904871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1147/2317] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:09 2022] DELETE /identity/v3/projects/1240c431367b4578b62ec6f485e96531 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:09.910434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c360-5683-4e0e-b23f-b161e0ce7224 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.910748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c360-5683-4e0e-b23f-b161e0ce7224 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.911009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2c360-5683-4e0e-b23f-b161e0ce7224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.934425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-54e2c360-5683-4e0e-b23f-b161e0ce7224 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:09.936038 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-54e2c360-5683-4e0e-b23f-b161e0ce7224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:09.937013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:09.944601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:09.946118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:09.947389 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:09.948052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] PATH_INFO: `/v3/projects/d96d65c8337b4288a25dccd2a5301b39` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:09.949090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:09.951298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96d65c8337b4288a25dccd2a5301b39)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:09.954341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.013395 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96d65c8337b4288a25dccd2a5301b39', 'request_id': 'req-b7e715cc-8ed5-4014-894e-54c3e98216ce'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.020203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1148/2318] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:10.028299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.028598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.028932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.047079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96d65c8337b4288a25dccd2a5301b39', 'request_id': 'req-b7e715cc-8ed5-4014-894e-54c3e98216ce'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.049788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:10.051193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.056314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96d65c8337b4288a25dccd2a5301b39', 'request_id': 'req-b7e715cc-8ed5-4014-894e-54c3e98216ce'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.072575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] The token cache is being invalidate because project d96d65c8337b4288a25dccd2a5301b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:10.072889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.074166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b7e715cc-8ed5-4014-894e-54c3e98216ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.075948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1171/2319] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:09 2022] DELETE /identity/v3/projects/d96d65c8337b4288a25dccd2a5301b39 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:10.081440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.081944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.082228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.103128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:10.104304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.120028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1149/2320] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:10.124465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.134546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8b709-192b-4b9e-ae8f-464404101922 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.141951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.142700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.142996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.143280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.144034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:58:10.144349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.146044 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.162060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1150/2321] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:58:10.163030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.164759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.183244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1172/2322] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:10.183387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af5d8-5a95-4521-a55d-8ed9c030c54d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.184161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.193187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.193809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7e32c-7a5c-485b-9324-85f2b04950d3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.194110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.194398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.194729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] PATH_INFO: `/v3/projects/d706d0f681eb4455945329034f639882` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.195936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d706d0f681eb4455945329034f639882)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.197905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.198465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3efc3-127a-4507-a416-0e9e9aad0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.199153 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3efc3-127a-4507-a416-0e9e9aad0121 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.199436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3efc3-127a-4507-a416-0e9e9aad0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.199711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3efc3-127a-4507-a416-0e9e9aad0121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.200407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3efc3-127a-4507-a416-0e9e9aad0121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.202336 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3efc3-127a-4507-a416-0e9e9aad0121 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.230995 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1173/2323] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:10.236331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.236719 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.237014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.249876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd706d0f681eb4455945329034f639882', 'request_id': 'req-a2540b8f-77a8-46a8-994d-09e8a4c03809'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.256309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:10.257340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd706d0f681eb4455945329034f639882', 'request_id': 'req-a2540b8f-77a8-46a8-994d-09e8a4c03809'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.257615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.265074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd706d0f681eb4455945329034f639882', 'request_id': 'req-a2540b8f-77a8-46a8-994d-09e8a4c03809'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.276149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] The token cache is being invalidate because project d706d0f681eb4455945329034f639882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:10.276443 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.277132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:10.286566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1151/2324] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:10 2022] DELETE /identity/v3/projects/d706d0f681eb4455945329034f639882 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:10.286566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.286566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.326188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:10.337919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1174/2325] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:10.342093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.352952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c17614-e8bd-4b31-aed2-4cd950b9f7b2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.359630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.360583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.360878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.361157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.361936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:58:10.362297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.364038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.366083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:10.377693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2540b8f-77a8-46a8-994d-09e8a4c03809 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.381211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1175/2326] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:58:10.386240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.386658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.387110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.387315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.387791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.388863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.390668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.400484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22a518-7b6b-4e71-97b2-ed98deea1162 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.408551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.409418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.409796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.410149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.411086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.413203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.421589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1152/2327] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:10.422330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.435564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9a077-f1d0-4288-8d97-24f205cd5bc6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.441789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.442599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.442957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.443305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.445312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.447889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.458502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1176/2328] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:10.464016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1153/2329] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:58:10.466877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.469058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.488442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f68ee1-b11f-4dfa-b720-05f0ebb1402e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.550691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.551437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.551727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.552008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.552749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.553370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eecc7a-3e34-43eb-a39e-04c806c00a72 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.554456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.559788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.560958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.561308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.561660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.563172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.565167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.568905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1154/2330] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:10.570156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.582439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba983-cea1-491c-a409-f39c56a303ca admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.587584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22905b-c091-473c-a8a7-eccb611a4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.588519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22905b-c091-473c-a8a7-eccb611a4560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.588802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22905b-c091-473c-a8a7-eccb611a4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.589079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22905b-c091-473c-a8a7-eccb611a4560 admin admin] PATH_INFO: `/v3/projects/aed696dce15a46df97041672475a0e3e/users/0b1de66d824141d59641b6ddcd0bd510/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.593750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1177/2331] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:10.598273 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.605541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22905b-c091-473c-a8a7-eccb611a4560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed696dce15a46df97041672475a0e3e, user_id=0b1de66d824141d59641b6ddcd0bd510, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.608128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22905b-c091-473c-a8a7-eccb611a4560 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.620351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d722-fb1a-495b-a9a3-aaf7e7e3d3ab admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.624936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1155/2332] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:58:10 2022] PUT /identity/v3/projects/aed696dce15a46df97041672475a0e3e/users/0b1de66d824141d59641b6ddcd0bd510/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:10.636378 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.636982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.636982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.666737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] MFA Rules not processed for user `0b1de66d824141d59641b6ddcd0bd510`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:10.668053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.694405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.695083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.695365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.695699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.696479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.698125 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.709765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1178/2333] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:10.713352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.723307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc63040-50a0-428f-b4bd-32cd5a526dfb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.728092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.728764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.729048 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.729325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.730112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.731718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.743889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1179/2334] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:10.747857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.758252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5631c37-1e73-41fd-adbe-d118385c7755 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.759191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1156/2335] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:10.769647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cde67-a65c-4998-a687-6b37f0fa9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.770820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cde67-a65c-4998-a687-6b37f0fa9536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.771005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.771354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cde67-a65c-4998-a687-6b37f0fa9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.771761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cde67-a65c-4998-a687-6b37f0fa9536 admin admin] PATH_INFO: `/v3/projects/da7bb235e85d4f0cb7d77862bbbc0bbb/users/8e6012d0ce82434ab6ee6fd1f1648718/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.774563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.785468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:10.789546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cde67-a65c-4998-a687-6b37f0fa9536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7bb235e85d4f0cb7d77862bbbc0bbb, user_id=8e6012d0ce82434ab6ee6fd1f1648718, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.795298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cde67-a65c-4998-a687-6b37f0fa9536 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.812981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1180/2336] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:58:10 2022] PUT /identity/v3/projects/da7bb235e85d4f0cb7d77862bbbc0bbb/users/8e6012d0ce82434ab6ee6fd1f1648718/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:58:10.818065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.818354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.818630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.835785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:10.836986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.846115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46d49-3db0-43a9-819d-1398a390f71e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.856109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:10.899502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323df0-2f23-42c4-a87b-e96e62b93730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.900098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323df0-2f23-42c4-a87b-e96e62b93730 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.900361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323df0-2f23-42c4-a87b-e96e62b93730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.900637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323df0-2f23-42c4-a87b-e96e62b93730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.905911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1181/2337] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:10.913894 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:10.915337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:10.966857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323df0-2f23-42c4-a87b-e96e62b93730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:10.968317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323df0-2f23-42c4-a87b-e96e62b93730 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:10.978010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1157/2338] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:10.985421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1eed0-a5ae-4f8e-9a34-8100c1deefb8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:10.989169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:10.989854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:10.990144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:10.990425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:10.999599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:11.001133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:11.011225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1182/2339] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:58:11.644676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230580a-5fff-40fb-a08c-90366c324c04 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:11.645164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230580a-5fff-40fb-a08c-90366c324c04 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:11.645251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230580a-5fff-40fb-a08c-90366c324c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:11.674475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2230580a-5fff-40fb-a08c-90366c324c04 None None] MFA Rules not processed for user `8e6012d0ce82434ab6ee6fd1f1648718`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:11.675799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2230580a-5fff-40fb-a08c-90366c324c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:11.759920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1158/2340] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:11.772732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:11.783041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103c3e-8f69-4985-b38d-93dd9a56b783 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:11.787563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e5f02-2113-4e74-9eac-8b5a2525c3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:11.788222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5f02-2113-4e74-9eac-8b5a2525c3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:11.788494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5f02-2113-4e74-9eac-8b5a2525c3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:11.788773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e5f02-2113-4e74-9eac-8b5a2525c3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:11.799094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5f02-2113-4e74-9eac-8b5a2525c3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:11.803104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e5f02-2113-4e74-9eac-8b5a2525c3c1 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:11.816938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1183/2341] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:13.227164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:13.227735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:13.227735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:13.240829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:13.249009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] MFA Rules not processed for user `8e6012d0ce82434ab6ee6fd1f1648718`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:13.250405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:13.264917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1159/2342] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:17.298204 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58402b97-95f8-448c-8b65-a4e1e90bcdd3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:17.298778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58402b97-95f8-448c-8b65-a4e1e90bcdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:17.298965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58402b97-95f8-448c-8b65-a4e1e90bcdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:17.318738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-58402b97-95f8-448c-8b65-a4e1e90bcdd3 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:17.320310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-58402b97-95f8-448c-8b65-a4e1e90bcdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:17.392578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1184/2343] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:58:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:17.441439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:17.443074 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:17.536761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626be20-6b11-4fe7-a755-852e3e0b5df7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:17.543053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:17.544023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:17.544448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:17.544867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:17.555698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:17.557808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:17.581805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1160/2344] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:58:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:58:18.416883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c8b0a-1ba4-45d0-a84c-59bd2b293bfd None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:18.417449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c8b0a-1ba4-45d0-a84c-59bd2b293bfd None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:18.417593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c8b0a-1ba4-45d0-a84c-59bd2b293bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:18.446791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-323c8b0a-1ba4-45d0-a84c-59bd2b293bfd None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:18.448343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-323c8b0a-1ba4-45d0-a84c-59bd2b293bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:18.456115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1185/2345] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 23 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:18.469196 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:18.480822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf13b3-45d7-42f2-aff8-2fa01cffdf3c service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:18.487579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:18.488239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:18.488527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:18.488807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:18.497482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:18.499157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:18.507660 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1161/2346] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:58:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:58:18.752027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58072fa-ed89-463e-b2cf-c2b50b930861 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:18.752422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58072fa-ed89-463e-b2cf-c2b50b930861 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:18.752795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58072fa-ed89-463e-b2cf-c2b50b930861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:18.774250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d58072fa-ed89-463e-b2cf-c2b50b930861 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:18.775570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d58072fa-ed89-463e-b2cf-c2b50b930861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:18.784841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1186/2347] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:18.797955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:18.810372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258644f-be94-4838-9fb0-8cc4b5341b9a service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:18.817069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:18.818633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:18.819103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:18.819548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:18.831184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:18.833286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:18.850857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1162/2348] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:58:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:58:19.251419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:19.251707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:19.252092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:19.270234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:19.271434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:19.284822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1187/2349] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 23 11:58:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:19.297474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:19.308332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a8b9-b1a9-443e-9597-f9680769a272 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:19.315246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0ea8-e100-48f8-81cc-31c8b2c9f48f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:19.316246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0ea8-e100-48f8-81cc-31c8b2c9f48f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:19.316534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0ea8-e100-48f8-81cc-31c8b2c9f48f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:19.316812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0ea8-e100-48f8-81cc-31c8b2c9f48f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:19.327186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0ea8-e100-48f8-81cc-31c8b2c9f48f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:19.328913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0ea8-e100-48f8-81cc-31c8b2c9f48f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:19.337917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1163/2350] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:58:21.820405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:21.822014 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:21.837833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95d90b-40f8-44b8-9551-87a200bd3ffe None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:21.850230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:21.851311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:21.851603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:21.851883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] PATH_INFO: `/v3/users/7a2e5c2320954fc290252b4d7b57c2f5` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:21.853470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2e5c2320954fc290252b4d7b57c2f5)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:21.855493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:21.901352 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:21.916712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2e5c2320954fc290252b4d7b57c2f5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:21.926299 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2e5c2320954fc290252b4d7b57c2f5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:21.934804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2e5c2320954fc290252b4d7b57c2f5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:21.935627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2e5c2320954fc290252b4d7b57c2f5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:21.948591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2e5c2320954fc290252b4d7b57c2f5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:21.955732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1188/2351] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:21 2022] DELETE /identity/v3/users/7a2e5c2320954fc290252b4d7b57c2f5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:21.960250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:21.960604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:21.960681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:21.982318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:21.984282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:22.065570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1164/2352] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:22.077056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:22.079076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:22.151864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe30ced-8919-4c9e-bc5f-b8a9bd0c547a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:22.156032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850f38-3734-4432-b784-3d32c1c28b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:22.157025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850f38-3734-4432-b784-3d32c1c28b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.157407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850f38-3734-4432-b784-3d32c1c28b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.157813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850f38-3734-4432-b784-3d32c1c28b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.167437 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a850f38-3734-4432-b784-3d32c1c28b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:22.168878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a850f38-3734-4432-b784-3d32c1c28b90 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:22.178860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1189/2353] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:22.414597 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:22.417016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:22.436306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7124ad1-5ea9-4176-870d-6abd834148f3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:22.450372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:22.451598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.452040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.458063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] PATH_INFO: `/v3/projects/28f34e7ba37b4f649bf3b7d25e70eb49` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.459494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f34e7ba37b4f649bf3b7d25e70eb49)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:22.461477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:22.515284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:22.518149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f34e7ba37b4f649bf3b7d25e70eb49', 'request_id': 'req-b43d42cb-1d70-446a-9db2-05a1c677ff49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:22.527723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f34e7ba37b4f649bf3b7d25e70eb49', 'request_id': 'req-b43d42cb-1d70-446a-9db2-05a1c677ff49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:22.534653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f34e7ba37b4f649bf3b7d25e70eb49', 'request_id': 'req-b43d42cb-1d70-446a-9db2-05a1c677ff49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:22.545860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] The token cache is being invalidate because project 28f34e7ba37b4f649bf3b7d25e70eb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:22.546157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:22.546786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b43d42cb-1d70-446a-9db2-05a1c677ff49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:22.548388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1165/2354] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:22 2022] DELETE /identity/v3/projects/28f34e7ba37b4f649bf3b7d25e70eb49 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:22.553392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.553645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.553934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.572645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:22.573889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:22.637785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1190/2355] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:22.646499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.646807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.647088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.667147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:22.668349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:22.677972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1166/2356] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:22.682200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:22.692545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa5d1d-d426-45a5-bdfb-6e08c42a7081 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:22.697285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:22.697993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.698280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.698562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.699302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:58:22.699616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:22.701236 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:22.714080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1191/2357] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 11:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:58:22.718418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:22.728206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a11347-117d-4e4a-8780-afbc975382a0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:22.733233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:22.734243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.734530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.734929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.736055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:22.738033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:22.767671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1167/2358] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 11:58:22 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:22.772594 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:22.786334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eaf02-fc0d-4aa7-9131-775818e46616 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:22.841340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:22.866384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:22.867295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.867679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.868056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.868926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:22.871098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:22.931206 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:22.934778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1192/2359] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 11:58:22 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:58:22.957487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6636c-b659-4283-84cf-3b25fa64a3a2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:22.976824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:22.977676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:22.977937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:22.978716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:22.979702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:22.981665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:22.996950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1168/2360] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:58:23.000803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:23.011726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f65f-6637-437a-b98d-16186acae97c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:23.016640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7156aad-9223-4fab-9a96-f48253ae19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:23.017265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7156aad-9223-4fab-9a96-f48253ae19a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:23.017559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7156aad-9223-4fab-9a96-f48253ae19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:23.017871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7156aad-9223-4fab-9a96-f48253ae19a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:23.018624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7156aad-9223-4fab-9a96-f48253ae19a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:23.020248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7156aad-9223-4fab-9a96-f48253ae19a2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:23.030707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1193/2361] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 11:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:58:23.035611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:23.046054 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c4cb-2a33-4729-b20e-15866594e9b0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:23.050717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:23.051607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:23.051891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:23.052168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] PATH_INFO: `/v3/projects/ad97799b6a4f420fa1a06b09cb20ee98/users/b01babb16fb04ebf800ea8481147f811/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:23.067528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad97799b6a4f420fa1a06b09cb20ee98, user_id=b01babb16fb04ebf800ea8481147f811, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:23.070462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:23.084548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1169/2362] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 11:58:23 2022] PUT /identity/v3/projects/ad97799b6a4f420fa1a06b09cb20ee98/users/b01babb16fb04ebf800ea8481147f811/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:23.095207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541222b-4445-4837-ba89-62a8af23940f None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:23.095582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541222b-4445-4837-ba89-62a8af23940f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:23.095866 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541222b-4445-4837-ba89-62a8af23940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:23.124660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3541222b-4445-4837-ba89-62a8af23940f None None] MFA Rules not processed for user `b01babb16fb04ebf800ea8481147f811`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:23.126061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3541222b-4445-4837-ba89-62a8af23940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:23.213208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1194/2363] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:23.225127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:23.227033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:23.302223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9b4f-14f9-4c4a-bc39-3485cfdc6541 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:23.306772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7f488-ba97-438e-8e86-ef92371dcbee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:23.307550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7f488-ba97-438e-8e86-ef92371dcbee service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:23.308358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7f488-ba97-438e-8e86-ef92371dcbee service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:23.308715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7f488-ba97-438e-8e86-ef92371dcbee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:23.319211 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7f488-ba97-438e-8e86-ef92371dcbee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:23.320787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7f488-ba97-438e-8e86-ef92371dcbee service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:23.333722 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1170/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:25.417634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:25.418093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:25.418188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:25.436446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] MFA Rules not processed for user `761bdea435cf43f98b28b371723f9478`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:25.437838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:25.502467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1195/2365] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:27.403185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:27.403656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:27.403804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:27.439528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:27.441272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:27.514405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1171/2366] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:27.529446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:27.530972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:27.607013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:27.626993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30a13-5a70-442b-a2b7-9a40133dbd17 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:27.632456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c9700-fdce-4cc5-b902-e2e63e74c977 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:27.633268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c9700-fdce-4cc5-b902-e2e63e74c977 service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:27.633623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c9700-fdce-4cc5-b902-e2e63e74c977 service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:27.633883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c9700-fdce-4cc5-b902-e2e63e74c977 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:27.647819 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c9700-fdce-4cc5-b902-e2e63e74c977 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:27.649452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c9700-fdce-4cc5-b902-e2e63e74c977 service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:27.658679 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1196/2367] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:58:28.588908 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:28.615346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:28.693170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef961b6-1f3e-4c37-adf5-3667525d25ed None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:28.743232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:28.744685 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:28.745121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:28.745549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] PATH_INFO: `/v3/users/b01babb16fb04ebf800ea8481147f811` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:28.747194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01babb16fb04ebf800ea8481147f811)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:28.749286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:28.827218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01babb16fb04ebf800ea8481147f811'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:28.838297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01babb16fb04ebf800ea8481147f811'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:28.841706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01babb16fb04ebf800ea8481147f811'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:28.856661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01babb16fb04ebf800ea8481147f811'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:28.859786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01babb16fb04ebf800ea8481147f811'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:28.901205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1172/2368] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:28 2022] DELETE /identity/v3/users/b01babb16fb04ebf800ea8481147f811 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:28.906087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:28.907011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:28.907506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:28.968613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:28.970031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:29.077581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1197/2369] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:29.085995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:29.087933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:29.195968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9aaa-0143-4bf6-8622-11d47b9a6c0c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:29.201416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75718c8-99e5-4304-bbe1-5dbc631369dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:29.202433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75718c8-99e5-4304-bbe1-5dbc631369dd service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:29.203200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75718c8-99e5-4304-bbe1-5dbc631369dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:29.203491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75718c8-99e5-4304-bbe1-5dbc631369dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:29.214487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75718c8-99e5-4304-bbe1-5dbc631369dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:29.216573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75718c8-99e5-4304-bbe1-5dbc631369dd service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:29.229392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1173/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:58:29.703156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:29.704663 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:29.738122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf123b2-2693-4e98-847f-b37bd2dbf0ca None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:29.743216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:29.744110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:29.744392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:29.744681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] PATH_INFO: `/v3/projects/ad97799b6a4f420fa1a06b09cb20ee98` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:29.745928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad97799b6a4f420fa1a06b09cb20ee98)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:29.747843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:29.884747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad97799b6a4f420fa1a06b09cb20ee98', 'request_id': 'req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:29.909483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad97799b6a4f420fa1a06b09cb20ee98', 'request_id': 'req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:29.922282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad97799b6a4f420fa1a06b09cb20ee98', 'request_id': 'req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:29.964403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] The token cache is being invalidate because project ad97799b6a4f420fa1a06b09cb20ee98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:29.964993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:29.965695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6b0c9c49-cc8b-406a-89b5-8014cc1f4064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:29.967970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1198/2371] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:29 2022] DELETE /identity/v3/projects/ad97799b6a4f420fa1a06b09cb20ee98 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:39.224527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:39.960688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:42.654811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37dd49-a0e2-4d11-bfba-d54a1f69bdad None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:42.655357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37dd49-a0e2-4d11-bfba-d54a1f69bdad None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:42.655572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37dd49-a0e2-4d11-bfba-d54a1f69bdad None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:42.658586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1174/2372] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:58:42.666926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c4630-b8a0-4443-8027-6f33c877efdf None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:42.667570 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c4630-b8a0-4443-8027-6f33c877efdf None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:42.667654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c4630-b8a0-4443-8027-6f33c877efdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:42.699247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-140c4630-b8a0-4443-8027-6f33c877efdf None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:42.700831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-140c4630-b8a0-4443-8027-6f33c877efdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:42.829178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1199/2373] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:58:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:42.835987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37dd49-a0e2-4d11-bfba-d54a1f69bdad None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:42.849836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5f37dd49-a0e2-4d11-bfba-d54a1f69bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:42.920208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37dd49-a0e2-4d11-bfba-d54a1f69bdad None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:42.924790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae9c8-8f1c-4095-a4cb-147ad7c5db5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:42.925446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae9c8-8f1c-4095-a4cb-147ad7c5db5a service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:42.925756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae9c8-8f1c-4095-a4cb-147ad7c5db5a service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:42.926034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae9c8-8f1c-4095-a4cb-147ad7c5db5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:42.937166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ae9c8-8f1c-4095-a4cb-147ad7c5db5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:42.938803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ae9c8-8f1c-4095-a4cb-147ad7c5db5a service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:42.950712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1175/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:43.022007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f6f3-3383-4891-8fff-33133ecb0de2 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.022326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f6f3-3383-4891-8fff-33133ecb0de2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.022607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f6f3-3383-4891-8fff-33133ecb0de2 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.024071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1200/2375] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:58:43.029093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5adc07-dbd8-4882-bdbd-bedf970659d7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.029495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5adc07-dbd8-4882-bdbd-bedf970659d7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.029879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5adc07-dbd8-4882-bdbd-bedf970659d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.062543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eb5adc07-dbd8-4882-bdbd-bedf970659d7 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:43.064377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb5adc07-dbd8-4882-bdbd-bedf970659d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:43.129571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1176/2376] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:43.141244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3f6f3-3383-4891-8fff-33133ecb0de2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:43.143183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c7e3f6f3-3383-4891-8fff-33133ecb0de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:43.157181 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3f6f3-3383-4891-8fff-33133ecb0de2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:43.161143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5cb98-a766-434c-a223-97a6d8c51143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:43.161802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cb98-a766-434c-a223-97a6d8c51143 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.162087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cb98-a766-434c-a223-97a6d8c51143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.162365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cb98-a766-434c-a223-97a6d8c51143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.170027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5cb98-a766-434c-a223-97a6d8c51143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:43.171453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5cb98-a766-434c-a223-97a6d8c51143 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:43.179282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1201/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:43.271659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b44c-6d0b-44e6-b01c-48061d788073 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.272383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b44c-6d0b-44e6-b01c-48061d788073 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.272383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b44c-6d0b-44e6-b01c-48061d788073 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.273925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1177/2378] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 11:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:58:43.279358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.279725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.280019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.300696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:43.301933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:43.311788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1202/2379] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:43.322898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37b44c-6d0b-44e6-b01c-48061d788073 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:43.324589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fe37b44c-6d0b-44e6-b01c-48061d788073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:43.339125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37b44c-6d0b-44e6-b01c-48061d788073 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:43.343359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c263-a3aa-46ea-aeaa-0c84f195c611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:43.344166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c263-a3aa-46ea-aeaa-0c84f195c611 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.344514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c263-a3aa-46ea-aeaa-0c84f195c611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.344824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c263-a3aa-46ea-aeaa-0c84f195c611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.356927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2c263-a3aa-46ea-aeaa-0c84f195c611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:43.359442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2c263-a3aa-46ea-aeaa-0c84f195c611 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:43.371577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1178/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:43.637918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:43.639977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:43.741370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:43.747743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bb7b5-bd95-4b3f-aa17-37751d6fbcf8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:43.753127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:43.754057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.754341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.754617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] PATH_INFO: `/v3/users/0b1de66d824141d59641b6ddcd0bd510` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.755843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1de66d824141d59641b6ddcd0bd510)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:43.758829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:43.819573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1de66d824141d59641b6ddcd0bd510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:43.828164 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1de66d824141d59641b6ddcd0bd510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:43.835943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1de66d824141d59641b6ddcd0bd510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:43.836673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1de66d824141d59641b6ddcd0bd510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:43.854814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1de66d824141d59641b6ddcd0bd510'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:43.870880 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1203/2381] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 11:58:43 2022] DELETE /identity/v3/users/0b1de66d824141d59641b6ddcd0bd510 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:43.873222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:43.873855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:43.874034 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:43.908149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:43.909492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:43.997734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1179/2382] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:58:44.004716 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:44.006479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:44.073229 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c54dbd-7090-491a-ba2d-057e04cfd0ec admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:44.077333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4c4b-d6c2-4262-9f6f-0fb424db0466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:44.077954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4c4b-d6c2-4262-9f6f-0fb424db0466 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:44.078709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4c4b-d6c2-4262-9f6f-0fb424db0466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:44.078709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4c4b-d6c2-4262-9f6f-0fb424db0466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:44.088563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4c4b-d6c2-4262-9f6f-0fb424db0466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:44.090168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4c4b-d6c2-4262-9f6f-0fb424db0466 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:44.101242 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1204/2383] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:58:44.417902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:44.419586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:44.435542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040398d7-5699-42f7-bec9-2d7d5b7fc5d8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:44.455643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babad127-929e-4335-a392-f35b65343593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:44.457124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babad127-929e-4335-a392-f35b65343593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:44.457546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babad127-929e-4335-a392-f35b65343593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:44.457962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babad127-929e-4335-a392-f35b65343593 admin admin] PATH_INFO: `/v3/projects/aed696dce15a46df97041672475a0e3e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:44.459713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babad127-929e-4335-a392-f35b65343593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed696dce15a46df97041672475a0e3e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:44.461811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babad127-929e-4335-a392-f35b65343593 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:44.473209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:44.521183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed696dce15a46df97041672475a0e3e', 'request_id': 'req-babad127-929e-4335-a392-f35b65343593'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:44.530143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed696dce15a46df97041672475a0e3e', 'request_id': 'req-babad127-929e-4335-a392-f35b65343593'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:44.538364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed696dce15a46df97041672475a0e3e', 'request_id': 'req-babad127-929e-4335-a392-f35b65343593'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:44.550425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-babad127-929e-4335-a392-f35b65343593 admin admin] The token cache is being invalidate because project aed696dce15a46df97041672475a0e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:58:44.550695 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:44.551338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:58:44.553564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1180/2384] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 11:58:44 2022] DELETE /identity/v3/projects/aed696dce15a46df97041672475a0e3e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:58:46.478230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fcd1-63c3-4ef6-bd80-ea280ac2a44b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:46.478754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fcd1-63c3-4ef6-bd80-ea280ac2a44b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:46.479504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fcd1-63c3-4ef6-bd80-ea280ac2a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:46.503378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-7ab6fcd1-63c3-4ef6-bd80-ea280ac2a44b None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:58:46.504588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7ab6fcd1-63c3-4ef6-bd80-ea280ac2a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:46.578180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1205/2385] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 11:58:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:58:46.590234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:58:46.591682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:58:46.675580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babad127-929e-4335-a392-f35b65343593 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:58:46.689136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:58:46.689820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:58:46.691116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:58:46.691416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:58:46.700711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:58:46.702370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:58:46.712176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1181/2386] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:58:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:58:56.560004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:56.709752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:02.262414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb509d6-330e-4b78-99cc-1b4c155aa695 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:02.263289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb509d6-330e-4b78-99cc-1b4c155aa695 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:02.263289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb509d6-330e-4b78-99cc-1b4c155aa695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:02.320828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-deb509d6-330e-4b78-99cc-1b4c155aa695 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:02.322003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-deb509d6-330e-4b78-99cc-1b4c155aa695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:02.390520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1206/2387] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:02.405821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:02.407409 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:02.515739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a35c03-aa4c-49ef-8bba-6f3d877aeeec service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:02.522462 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:02.523141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:02.523424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:02.523698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:02.532647 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:02.534546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:02.544271 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1182/2388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:05.293381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88f85b-fe8a-4ab0-86ed-8de03bbada17 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:05.293989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88f85b-fe8a-4ab0-86ed-8de03bbada17 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:05.293989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88f85b-fe8a-4ab0-86ed-8de03bbada17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:05.313565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5e88f85b-fe8a-4ab0-86ed-8de03bbada17 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:05.315058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5e88f85b-fe8a-4ab0-86ed-8de03bbada17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:05.324361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1207/2389] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:05.341938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:05.344170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:05.367655 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1498626-97fb-426b-937d-5683a3dfd1aa service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:05.374308 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:05.374958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:05.375267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:05.375538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:05.384374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:05.386039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:05.395736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1183/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:06.739826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a98d-1949-49d3-a0b0-637135f2b1d4 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:06.740293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a98d-1949-49d3-a0b0-637135f2b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:06.740384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a98d-1949-49d3-a0b0-637135f2b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:06.770533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0196a98d-1949-49d3-a0b0-637135f2b1d4 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:06.771753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0196a98d-1949-49d3-a0b0-637135f2b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:06.779447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1208/2391] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 23 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:06.791859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:06.803627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8105b-7d68-468d-99eb-56caf321dfe9 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:06.809172 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:06.809858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:06.810145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:06.810422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:06.819286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:06.820902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:06.829161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1184/2392] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 11:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:59:09.573506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed66a1-31e9-4be8-8cc9-b204f005f06d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:09.574122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed66a1-31e9-4be8-8cc9-b204f005f06d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:09.574122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed66a1-31e9-4be8-8cc9-b204f005f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:09.594560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-68ed66a1-31e9-4be8-8cc9-b204f005f06d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:09.595917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-68ed66a1-31e9-4be8-8cc9-b204f005f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:09.605195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1209/2393] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:09.620005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:09.632610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d29ae-473c-4543-8b4c-5076cffed32a service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:09.639418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:09.640060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:09.640346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:09.640625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:09.651047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:09.652858 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:09.663906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1185/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:12.662368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18c76-edd8-4248-ad9f-a5979d0e9d51 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:12.662890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18c76-edd8-4248-ad9f-a5979d0e9d51 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:12.662890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18c76-edd8-4248-ad9f-a5979d0e9d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:12.682583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-acf18c76-edd8-4248-ad9f-a5979d0e9d51 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:12.683787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-acf18c76-edd8-4248-ad9f-a5979d0e9d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:12.692936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1210/2395] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:12.716911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:12.729333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f469b-eeb4-4456-9bd4-0225162cc6d7 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:12.736654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:12.737292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:12.737570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:12.737868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:12.746631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:12.748224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:12.758388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1186/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:15.847572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b73e6-7c41-4586-89e4-788f854672b8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:15.848087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b73e6-7c41-4586-89e4-788f854672b8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:15.848203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b73e6-7c41-4586-89e4-788f854672b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:15.868869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c43b73e6-7c41-4586-89e4-788f854672b8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:15.870443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c43b73e6-7c41-4586-89e4-788f854672b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:15.879320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1211/2397] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:15.895992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:15.908327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357ebed-c49f-406d-8ec2-dc8203212d3d service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:15.914674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:15.915335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:15.915619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:15.915895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:15.925223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:15.926899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:15.937198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1187/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:19.029079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:19.029567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:19.029697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:19.039569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:19.041087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:19.049488 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:19.050898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:19.059447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1212/2399] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:19.076268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:19.088911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1560e-2cf8-4d77-ae1a-f03891a1f812 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:19.095797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d24822-bf85-48a1-ad0b-c4289e61958f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:19.096432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24822-bf85-48a1-ad0b-c4289e61958f service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:19.096715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24822-bf85-48a1-ad0b-c4289e61958f service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:19.096991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d24822-bf85-48a1-ad0b-c4289e61958f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:19.103532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:19.106529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24822-bf85-48a1-ad0b-c4289e61958f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:19.108102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d24822-bf85-48a1-ad0b-c4289e61958f service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:19.119916 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1213/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:19.138588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0924291-43a7-450a-85d3-4e3716a0699d service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:19.144538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:19.145202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:19.145489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:19.145804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:19.147649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:19.160541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:19.162233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c37f3-34c1-4c6e-98ed-552bb9cc0a5e service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:19.173014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1188/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:59:29.115139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=66 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:29.168352 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=17 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:34.426315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:34.426908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:34.426908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:34.447978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] MFA Rules not processed for user `8e6012d0ce82434ab6ee6fd1f1648718`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:34.449180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:34.525435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1214/2402] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:59:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:44.509505 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=25 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:49.750027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743ad2-2c40-4c35-9b53-268dfaef2e82 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:49.750876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743ad2-2c40-4c35-9b53-268dfaef2e82 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:49.750876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a743ad2-2c40-4c35-9b53-268dfaef2e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:49.769825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6a743ad2-2c40-4c35-9b53-268dfaef2e82 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:49.770354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6a743ad2-2c40-4c35-9b53-268dfaef2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:49.780055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1189/2403] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:49.793956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:49.808047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f3936-f693-4a80-a630-17f00a2cca3a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:49.817387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:49.817387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:49.817387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:49.817387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:49.826426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:49.828032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:49.839168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1215/2404] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:53.040302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c388e-fc18-4a1d-9e79-814c2d538ce0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:53.040893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c388e-fc18-4a1d-9e79-814c2d538ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:53.040893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c388e-fc18-4a1d-9e79-814c2d538ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:53.060273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8d1c388e-fc18-4a1d-9e79-814c2d538ce0 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:53.061498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d1c388e-fc18-4a1d-9e79-814c2d538ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:53.070953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1190/2405] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:53.085282 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:53.096956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde54fb-44ea-4c5c-b780-6633b73333bb service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:53.103794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadf802-a5c1-4d67-9bca-1c35bc9ff59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:53.104438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadf802-a5c1-4d67-9bca-1c35bc9ff59b service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:53.104721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadf802-a5c1-4d67-9bca-1c35bc9ff59b service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:53.104999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadf802-a5c1-4d67-9bca-1c35bc9ff59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:53.114449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadf802-a5c1-4d67-9bca-1c35bc9ff59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:53.116047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadf802-a5c1-4d67-9bca-1c35bc9ff59b service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:53.125893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1216/2406] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:59:54.628802 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3cf75-ff34-4ac5-a08f-76919fefe7d6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:54.629371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3cf75-ff34-4ac5-a08f-76919fefe7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:54.629542 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3cf75-ff34-4ac5-a08f-76919fefe7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:54.648400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fdf3cf75-ff34-4ac5-a08f-76919fefe7d6 None None] MFA Rules not processed for user `761bdea435cf43f98b28b371723f9478`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:54.649654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fdf3cf75-ff34-4ac5-a08f-76919fefe7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:54.708860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1191/2407] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:55.626828 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714441b-e460-4247-9004-f3a44e343093 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:55.627275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714441b-e460-4247-9004-f3a44e343093 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:55.627641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714441b-e460-4247-9004-f3a44e343093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:55.645739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0714441b-e460-4247-9004-f3a44e343093 None None] MFA Rules not processed for user `e50d226291da44b5a2c35f79726ff3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:55.647030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0714441b-e460-4247-9004-f3a44e343093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:55.703110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1217/2408] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:56.104951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5aeca-9279-4488-bd1e-a4fb004dccdc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:56.105424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5aeca-9279-4488-bd1e-a4fb004dccdc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:56.105518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5aeca-9279-4488-bd1e-a4fb004dccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:56.126432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-65d5aeca-9279-4488-bd1e-a4fb004dccdc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:59:56.127653 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65d5aeca-9279-4488-bd1e-a4fb004dccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:59:56.137252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1192/2409] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:59:56.338445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714441b-e460-4247-9004-f3a44e343093 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:59:56.353057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714441b-e460-4247-9004-f3a44e343093 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:59:56.360331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:59:56.361004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:59:56.361285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:59:56.361633 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:59:56.371914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:59:56.373514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:59:56.383966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1218/2410] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 11:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:00:01.348313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432830-c9de-44bb-aac5-4a059a02d505 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:01.348837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432830-c9de-44bb-aac5-4a059a02d505 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:01.349181 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432830-c9de-44bb-aac5-4a059a02d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:01.369690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-42432830-c9de-44bb-aac5-4a059a02d505 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:00:01.370967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-42432830-c9de-44bb-aac5-4a059a02d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:00:01.379427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1193/2411] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:00:01.403841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:00:01.416343 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c29dda-6f1c-4eb9-b97b-72c10a971c02 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:00:01.423176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:00:01.423944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:01.424455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:01.424938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:01.436376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:00:01.438486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:00:01.447901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1219/2412] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:00:04.518146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77141d-398b-4678-90ad-ed88e39ddc73 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:04.518692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77141d-398b-4678-90ad-ed88e39ddc73 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:04.518692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77141d-398b-4678-90ad-ed88e39ddc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:04.537268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1e77141d-398b-4678-90ad-ed88e39ddc73 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:00:04.538589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e77141d-398b-4678-90ad-ed88e39ddc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:00:04.547064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1194/2413] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Jun 23 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:00:04.561685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:00:04.573410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034d0b8-bb25-42dc-8a9d-112285962984 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:00:04.580007 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bbd6c-19c0-4410-8f5d-2448ed5081e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:00:04.580665 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bbd6c-19c0-4410-8f5d-2448ed5081e8 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:04.580951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bbd6c-19c0-4410-8f5d-2448ed5081e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:04.581228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bbd6c-19c0-4410-8f5d-2448ed5081e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:04.590657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bbd6c-19c0-4410-8f5d-2448ed5081e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:00:04.592260 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bbd6c-19c0-4410-8f5d-2448ed5081e8 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:00:04.603797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1220/2414] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:00:14.531785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=40 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:14.603119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=55 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:21.031821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b659-a8d2-495a-8a56-1f10f3f139c5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:21.032351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b659-a8d2-495a-8a56-1f10f3f139c5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:21.032351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b659-a8d2-495a-8a56-1f10f3f139c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:21.050563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1299b659-a8d2-495a-8a56-1f10f3f139c5 None None] MFA Rules not processed for user `cdc4a7650e904ba990d9ced0fda14bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:00:21.051839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1299b659-a8d2-495a-8a56-1f10f3f139c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:00:21.119971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1195/2415] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:00:31.112748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=25 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:36.485178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366a35d-4ff9-4daa-9d38-9ad945f96c11 None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:36.485781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366a35d-4ff9-4daa-9d38-9ad945f96c11 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:36.485781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366a35d-4ff9-4daa-9d38-9ad945f96c11 None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:36.487428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1221/2416] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 12:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:00:36.498106 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:36.498609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:36.498765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:36.538920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] MFA Rules not processed for user `12a98501cfe942dda4c2c8350215bcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:00:36.540153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:00:36.550035 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1196/2417] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 12:00:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:00:36.564578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366a35d-4ff9-4daa-9d38-9ad945f96c11 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:00:36.582893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:00:36.583965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366a35d-4ff9-4daa-9d38-9ad945f96c11 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:00:36.584341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:00:36.589640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:00:36.590519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:36.590807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:36.591070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:36.600385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5478a8-56f5-48ab-b03d-2a9beb552e4e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:00:36.605283 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:00:36.605447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:00:36.606578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:36.606578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:36.606771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] PATH_INFO: `/v3/users/8e6012d0ce82434ab6ee6fd1f1648718` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:36.606972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:00:36.608712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6012d0ce82434ab6ee6fd1f1648718)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:00:36.611140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:00:36.618836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1222/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:00:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:00:36.664713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6012d0ce82434ab6ee6fd1f1648718'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:36.673797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6012d0ce82434ab6ee6fd1f1648718'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:36.674980 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6012d0ce82434ab6ee6fd1f1648718'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:36.686931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6012d0ce82434ab6ee6fd1f1648718'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:36.687608 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6012d0ce82434ab6ee6fd1f1648718'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:36.705190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1197/2419] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:00:36 2022] DELETE /identity/v3/users/8e6012d0ce82434ab6ee6fd1f1648718 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:00:36.887651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:00:36.898390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69890-dd60-4562-a565-d4c5a17c2eab service placement] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:00:36.960175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:00:36.961035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:00:36.961315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:00:36.961589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] PATH_INFO: `/v3/projects/da7bb235e85d4f0cb7d77862bbbc0bbb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:00:36.962809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7bb235e85d4f0cb7d77862bbbc0bbb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:00:36.964702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:00:37.016573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7bb235e85d4f0cb7d77862bbbc0bbb', 'request_id': 'req-34393316-55a1-4123-a49b-6d5bbedc63d0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:37.024468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7bb235e85d4f0cb7d77862bbbc0bbb', 'request_id': 'req-34393316-55a1-4123-a49b-6d5bbedc63d0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:37.030785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7bb235e85d4f0cb7d77862bbbc0bbb', 'request_id': 'req-34393316-55a1-4123-a49b-6d5bbedc63d0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:37.040966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] The token cache is being invalidate because project da7bb235e85d4f0cb7d77862bbbc0bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:00:37.041252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:37.041897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:00:37.043446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1223/2420] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:00:36 2022] DELETE /identity/v3/projects/da7bb235e85d4f0cb7d77862bbbc0bbb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:00:46.701586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:47.038263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:00.051392 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.052978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:00.068159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0abeb-bd59-4ec6-99ce-2043d59676b3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.126749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.127632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.127918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.128194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] PATH_INFO: `/v3/users/761bdea435cf43f98b28b371723f9478` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.129432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=761bdea435cf43f98b28b371723f9478)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.131451 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.184008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761bdea435cf43f98b28b371723f9478'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.191598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761bdea435cf43f98b28b371723f9478'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.192298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761bdea435cf43f98b28b371723f9478'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.201254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761bdea435cf43f98b28b371723f9478'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.201926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-156b6f8a-7805-47ea-b827-d18fe9f33f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761bdea435cf43f98b28b371723f9478'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.219187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1198/2421] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:00 2022] DELETE /identity/v3/users/761bdea435cf43f98b28b371723f9478 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:00.405519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.407058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:00.420421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393316-55a1-4123-a49b-6d5bbedc63d0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.486904 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.488039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.488408 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.488840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] PATH_INFO: `/v3/projects/46979fe7d4ab457c9e8e8ccebfa3920f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.490933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46979fe7d4ab457c9e8e8ccebfa3920f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.494032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.550496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46979fe7d4ab457c9e8e8ccebfa3920f', 'request_id': 'req-e58f29a6-b28b-42cd-93cc-97596a337b29'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.559462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46979fe7d4ab457c9e8e8ccebfa3920f', 'request_id': 'req-e58f29a6-b28b-42cd-93cc-97596a337b29'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.566860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46979fe7d4ab457c9e8e8ccebfa3920f', 'request_id': 'req-e58f29a6-b28b-42cd-93cc-97596a337b29'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.578715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] The token cache is being invalidate because project 46979fe7d4ab457c9e8e8ccebfa3920f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:00.579010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.579728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e58f29a6-b28b-42cd-93cc-97596a337b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:00.581321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1224/2422] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:00 2022] DELETE /identity/v3/projects/46979fe7d4ab457c9e8e8ccebfa3920f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:00.586430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.586720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.587000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.606920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:00.609026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:00.670217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1199/2423] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:00.678718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.679009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.679286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.699461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:00.700722 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:00.709761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1225/2424] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:00.714171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.724214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281a71-1f80-4e1c-a4ae-ef0e8c562209 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.729124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.729820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.730110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.730391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.731154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:01:00.731483 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.733429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.745564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1200/2425] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:01:00.750284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.759918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea792fa9-be6c-42d1-ad29-c49f5bfa6a46 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.765990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.766661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.766953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.767233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.767939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.769934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.797326 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1226/2426] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:00 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:00.801591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.811987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62810a67-006f-43e2-b57a-9516a259ab3a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.816062 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:00.874952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.875630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.875918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.876195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.876909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.878879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.902184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1201/2427] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:00 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:00.906739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.917517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d04a9-0db9-4a59-9f02-4f92cc345bc8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.923946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.924620 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.924905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.925184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.925959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.927573 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.939183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1227/2428] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:00.943348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.954391 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac182-4be8-4887-a585-bc7419656756 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.959556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39123a1f-df49-41df-b756-7736c18001a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.960223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123a1f-df49-41df-b756-7736c18001a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.960536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123a1f-df49-41df-b756-7736c18001a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.960822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123a1f-df49-41df-b756-7736c18001a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:00.961559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39123a1f-df49-41df-b756-7736c18001a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:00.963207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39123a1f-df49-41df-b756-7736c18001a7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:00.974017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1202/2429] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:00.978789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:00.989444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f722e-16b6-4a16-8efb-d1b20beed57e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:00.994610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:00.995484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:00.995768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:00.996069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] PATH_INFO: `/v3/projects/5b3300475d7b4add905684b9e7772949/users/f5b8e8e45345409c835d5867166da134/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:01.013423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3300475d7b4add905684b9e7772949, user_id=f5b8e8e45345409c835d5867166da134, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:01.016163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:01.037134 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1228/2430] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:00 2022] PUT /identity/v3/projects/5b3300475d7b4add905684b9e7772949/users/f5b8e8e45345409c835d5867166da134/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:01.044515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90365-4272-4d82-9066-801d1e6f397d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:01.044854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90365-4272-4d82-9066-801d1e6f397d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:01.045266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90365-4272-4d82-9066-801d1e6f397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:01.064097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-23a90365-4272-4d82-9066-801d1e6f397d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:01.065236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-23a90365-4272-4d82-9066-801d1e6f397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:01.131236 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1203/2431] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:01.140770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:01.142599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:01.173511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:01.202129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f09502-f8e1-4766-8b47-6e1871f80b2e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:01.205847 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:01.206494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:01.206790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:01.207053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:01.217231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:01.218704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:01.232348 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1229/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:05.074755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589883-3a08-4cd2-afdf-fc8d791fde42 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:05.075238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589883-3a08-4cd2-afdf-fc8d791fde42 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:05.075349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc589883-3a08-4cd2-afdf-fc8d791fde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:05.102037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dc589883-3a08-4cd2-afdf-fc8d791fde42 None None] MFA Rules not processed for user `f5b8e8e45345409c835d5867166da134`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:05.103252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dc589883-3a08-4cd2-afdf-fc8d791fde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:05.186583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1204/2433] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:05.201084 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:05.202624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:05.287954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02221ba9-cb01-4574-a5c0-f5ec8ee33615 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:05.301195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8684-b8d1-446b-b4d4-3de18556bc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:05.301976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8684-b8d1-446b-b4d4-3de18556bc48 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:05.303774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8684-b8d1-446b-b4d4-3de18556bc48 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:05.303774 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8684-b8d1-446b-b4d4-3de18556bc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:05.322791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8684-b8d1-446b-b4d4-3de18556bc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:05.324460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8684-b8d1-446b-b4d4-3de18556bc48 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:05.334269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1230/2434] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:01:06.770279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:06.770889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:06.770889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:06.790070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] MFA Rules not processed for user `f5b8e8e45345409c835d5867166da134`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:06.791278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:06.798772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1205/2435] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:14.103642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:14.104109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:14.104444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:14.163099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:14.165132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:14.256530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1231/2436] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:14.305021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:14.306641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:14.321121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:14.431298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e578-b55f-48a9-ad39-6c0133b659f9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:14.436487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:14.437256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:14.437640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:14.438122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:14.447569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:14.449334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:14.457783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1206/2437] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:01:17.231769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:17.234388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:17.251227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888805e-b3ef-4e15-a946-39be768ff804 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:17.255162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:17.255830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:17.256130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:17.256470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:17.258447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:17.282697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:17.284210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:17.297717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1232/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:17.339922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:17.354629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9006-6132-4e66-9430-0967c7a0107f service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:17.359099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:17.359984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:17.360272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:17.360999 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:17.362605 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:17.387215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:17.392145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66831072-2648-46c6-a91a-716c1c8ebcb7 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:17.408730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1207/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:25.967972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:25.969631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:25.984558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdb727-8f75-4261-a72b-2edc7885ad96 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:25.990906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:25.991592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:25.991884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:25.992165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:25.994108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:26.005085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:26.061543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:26.063313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425acc8-08a1-4e15-84c3-65bb2ae58ed3 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:26.073321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1233/2440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:27.400860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=43 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:28.336803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd17aa-2563-4fb8-819e-6bcf5112d5fd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.337093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd17aa-2563-4fb8-819e-6bcf5112d5fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.337383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd17aa-2563-4fb8-819e-6bcf5112d5fd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.338846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1208/2441] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 12:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:01:28.352733 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662e97-44c0-43f9-b7fa-1b8bc2fc92ec None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.353864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662e97-44c0-43f9-b7fa-1b8bc2fc92ec None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.354357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662e97-44c0-43f9-b7fa-1b8bc2fc92ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.402635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c8662e97-44c0-43f9-b7fa-1b8bc2fc92ec None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:28.404397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c8662e97-44c0-43f9-b7fa-1b8bc2fc92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:28.420719 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1234/2442] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:28.430326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd17aa-2563-4fb8-819e-6bcf5112d5fd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:28.433673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7abd17aa-2563-4fb8-819e-6bcf5112d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:28.533066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd17aa-2563-4fb8-819e-6bcf5112d5fd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:28.536753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ee80a-6c93-4564-8b2c-e69c8e76c754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:28.537486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ee80a-6c93-4564-8b2c-e69c8e76c754 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.537861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ee80a-6c93-4564-8b2c-e69c8e76c754 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.538232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ee80a-6c93-4564-8b2c-e69c8e76c754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.549492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ee80a-6c93-4564-8b2c-e69c8e76c754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:28.551037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ee80a-6c93-4564-8b2c-e69c8e76c754 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:28.563051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1209/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:28.643562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c12f7f-6206-4eae-b58a-7f00f5527b3f None None] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.643562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c12f7f-6206-4eae-b58a-7f00f5527b3f None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.643562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c12f7f-6206-4eae-b58a-7f00f5527b3f None None] PATH_INFO: `/` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.645003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1235/2444] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 12:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:01:28.650417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4703-20ba-4ac3-9c23-76fbe9ca5fa4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.650930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4703-20ba-4ac3-9c23-76fbe9ca5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.651282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4703-20ba-4ac3-9c23-76fbe9ca5fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.671432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2cef4703-20ba-4ac3-9c23-76fbe9ca5fa4 None None] MFA Rules not processed for user `e3808efbe570448c8780ed114d0379e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:28.672733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2cef4703-20ba-4ac3-9c23-76fbe9ca5fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:28.680609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1210/2445] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:28.692898 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c12f7f-6206-4eae-b58a-7f00f5527b3f None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:28.704165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c12f7f-6206-4eae-b58a-7f00f5527b3f None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:28.707756 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15994e1a-719b-4ed0-8c9c-ab68ed67af32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:28.708411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994e1a-719b-4ed0-8c9c-ab68ed67af32 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.708743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994e1a-719b-4ed0-8c9c-ab68ed67af32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.709040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15994e1a-719b-4ed0-8c9c-ab68ed67af32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.716531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15994e1a-719b-4ed0-8c9c-ab68ed67af32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:28.718106 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15994e1a-719b-4ed0-8c9c-ab68ed67af32 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:28.726051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1236/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:28.812583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7a279-56ed-4d3f-be03-99f2e43668b9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.813064 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7a279-56ed-4d3f-be03-99f2e43668b9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.813424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7a279-56ed-4d3f-be03-99f2e43668b9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.814966 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1211/2447] 10.222.0.27 () {54 vars in 921 bytes} [Thu Jun 23 12:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:01:28.821025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eefa9-d02b-468f-a0d4-e540f60780da None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.821385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eefa9-d02b-468f-a0d4-e540f60780da None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.821694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eefa9-d02b-468f-a0d4-e540f60780da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.843701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d27eefa9-d02b-468f-a0d4-e540f60780da None None] MFA Rules not processed for user `7d5dafc333e54d20aebe2929e1f8a4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:28.844923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d27eefa9-d02b-468f-a0d4-e540f60780da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:28.859749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1237/2448] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Jun 23 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:28.870644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7a279-56ed-4d3f-be03-99f2e43668b9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:28.883330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7a279-56ed-4d3f-be03-99f2e43668b9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:28.887646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:28.888377 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:28.888658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:28.889033 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:28.900007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:28.901448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:28.912406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1212/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:30.518494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:30.519008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:30.519115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:30.537782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:30.538981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:30.547268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1238/2450] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 12:01:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:30.559242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:30.571349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07151e0-a910-465a-9fe8-c19912787e9e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:30.577284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:30.577971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:30.578250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:30.578530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:30.587050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:30.588649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:30.597312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1213/2451] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:01:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:01:32.210036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:32.223971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b878-422f-41c9-9e3a-28f6d2635b0a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:32.227823 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:32.228489 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:32.228773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:32.229053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:32.230914 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:32.244744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:32.246308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:32.261213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1239/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:36.414067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:36.416013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:36.442115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda118d6-41f2-43f9-a9f5-4de2c931457f service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:36.448198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:36.449274 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:36.449519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:36.449831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] PATH_INFO: `/v3/users/cdc4a7650e904ba990d9ced0fda14bff` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:36.451376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc4a7650e904ba990d9ced0fda14bff)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:36.460927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:36.547656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc4a7650e904ba990d9ced0fda14bff'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.555521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc4a7650e904ba990d9ced0fda14bff'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.558013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc4a7650e904ba990d9ced0fda14bff'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.574876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc4a7650e904ba990d9ced0fda14bff'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.575740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2fb22753-35f9-4d8f-a348-3e8460955e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc4a7650e904ba990d9ced0fda14bff'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.595536 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1214/2453] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:36 2022] DELETE /identity/v3/users/cdc4a7650e904ba990d9ced0fda14bff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:36.795804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:36.809156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10814048-75ad-4c32-bb61-3a1c75465c4f service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:36.898120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:36.898998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:36.899321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:36.899598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] PATH_INFO: `/v3/projects/c9ff40710f1740c4a0bb420c4d604b8c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:36.900840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ff40710f1740c4a0bb420c4d604b8c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:36.902786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:36.960301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ff40710f1740c4a0bb420c4d604b8c', 'request_id': 'req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.964141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:36.975482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ff40710f1740c4a0bb420c4d604b8c', 'request_id': 'req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.986521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ff40710f1740c4a0bb420c4d604b8c', 'request_id': 'req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.998661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] The token cache is being invalidate because project c9ff40710f1740c4a0bb420c4d604b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:36.998954 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:36.999617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1dd61ed3-dab2-4e59-9f58-db77cf5f26fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:37.001227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1240/2454] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:36 2022] DELETE /identity/v3/projects/c9ff40710f1740c4a0bb420c4d604b8c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:37.006329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.006623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.006902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.025982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:37.027222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:37.046371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:37.097817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1215/2455] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:37.114334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.114334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.114334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.144419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:37.144419 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:37.152315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1241/2456] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:37.156682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.166558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d30a2-82b8-4447-9d6f-c70abde8f583 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.171331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.172030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.172281 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.172555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.173311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:01:37.173641 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.175257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.189636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1216/2457] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:01:37.192139 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.207724 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c72ae-30f8-4591-a727-4dada6c517be None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.214312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.214832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.215199 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.215684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.216544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.219207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.262141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1242/2458] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:37 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:37.263561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.275077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0daf0-ad30-4e46-83f4-f7f2b767a52c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.339953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.340967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.341403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.342250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.344216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.346519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.373665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1217/2459] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:37 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:01:37.378498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.396922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aca1a-9c38-4ae1-ae57-a1401c0e835d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.402757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.403445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.403747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.404082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.406053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.407856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.438509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1243/2460] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:37.439662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.454325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555cecd-6a5f-41f7-986f-85843016421a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.460623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642487f6-686e-41b5-908c-82bf1e41aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.462668 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642487f6-686e-41b5-908c-82bf1e41aa70 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.463174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642487f6-686e-41b5-908c-82bf1e41aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.463758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642487f6-686e-41b5-908c-82bf1e41aa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.464822 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642487f6-686e-41b5-908c-82bf1e41aa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.466996 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642487f6-686e-41b5-908c-82bf1e41aa70 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.481919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1218/2461] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:01:37.487033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.501140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f18b3d-1991-4223-bcc4-ebe66d42cf4d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.514757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.516158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.516467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.516870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] PATH_INFO: `/v3/projects/285ecdb759364badbb678326891e9e01/users/a3c02fd4e0c24e8a8b9b7b055ce56654/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.551750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285ecdb759364badbb678326891e9e01, user_id=a3c02fd4e0c24e8a8b9b7b055ce56654, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.554645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.590931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1244/2462] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:37 2022] PUT /identity/v3/projects/285ecdb759364badbb678326891e9e01/users/a3c02fd4e0c24e8a8b9b7b055ce56654/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:37.597665 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68722ef5-4ba1-480d-8da5-1c43a427a2e6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.598259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68722ef5-4ba1-480d-8da5-1c43a427a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.598540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68722ef5-4ba1-480d-8da5-1c43a427a2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.619454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-68722ef5-4ba1-480d-8da5-1c43a427a2e6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:37.620792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-68722ef5-4ba1-480d-8da5-1c43a427a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:37.710367 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1219/2463] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:37.724952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:37.727152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:37.795734 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afaf7e-228d-4031-b146-1bfbbb6955d6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:37.799441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:37.800444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:37.800444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:37.800652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:37.811087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:37.812786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:37.826387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1245/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:38.627958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:38.629187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:38.629993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:38.663221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] MFA Rules not processed for user `a3c02fd4e0c24e8a8b9b7b055ce56654`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:38.664745 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:38.684238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:38.746851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:38.747603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1220/2465] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:38.758081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d178c-106c-479f-bf6a-e7b9c5f38a8b service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:38.763227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:38.764132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:38.764611 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:38.764888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:38.765587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:38.767528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:38.804407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1246/2466] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:38 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:38.808247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:38.820348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81b11-edf2-4827-9a6b-31764ed85062 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:38.881976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:38.882827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:38.883116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:38.883422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:38.884131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:38.886174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:38.909048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1221/2467] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:38 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:38.913378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:38.924126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24da36-9bee-4cd1-9ee0-16a68f1ab4d5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:38.932191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:38.932885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:38.933187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:38.933443 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:38.934226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:38.936148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:38.947178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1247/2468] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:38.952136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:38.966169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b523-5edc-4524-93aa-705559135bd2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:38.971337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:38.972257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:38.972543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:38.972825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] PATH_INFO: `/v3/projects/341349b2d80740cda16cc16a3749a36b/users/9b294c3e99ef4a91bb1f223330b6d8a5/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:38.988121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341349b2d80740cda16cc16a3749a36b, user_id=9b294c3e99ef4a91bb1f223330b6d8a5, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:38.990841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:39.006417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1222/2469] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:38 2022] PUT /identity/v3/projects/341349b2d80740cda16cc16a3749a36b/users/9b294c3e99ef4a91bb1f223330b6d8a5/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:39.010511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:39.021398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b1f4f-89f1-474c-9434-d7a183db4988 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:39.066521 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:39.083205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d040fe-57c4-44ce-ba79-5fb7c7190cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:39.083885 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d040fe-57c4-44ce-ba79-5fb7c7190cba admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:39.084215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d040fe-57c4-44ce-ba79-5fb7c7190cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:39.084474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d040fe-57c4-44ce-ba79-5fb7c7190cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:39.085222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d040fe-57c4-44ce-ba79-5fb7c7190cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:39.086936 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d040fe-57c4-44ce-ba79-5fb7c7190cba admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:39.097458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1248/2470] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:39.101759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:39.112555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0461-60a1-43b9-be17-57bcd6a29e55 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:39.117626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:39.118504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:39.118782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:39.119053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] PATH_INFO: `/v3/projects/341349b2d80740cda16cc16a3749a36b/users/9b294c3e99ef4a91bb1f223330b6d8a5/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:39.121091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=341349b2d80740cda16cc16a3749a36b, user_id=9b294c3e99ef4a91bb1f223330b6d8a5, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:39.123839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:39.134664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1223/2471] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:39 2022] PUT /identity/v3/projects/341349b2d80740cda16cc16a3749a36b/users/9b294c3e99ef4a91bb1f223330b6d8a5/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:39.995908 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:39.996454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:39.996454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:40.024198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] MFA Rules not processed for user `9b294c3e99ef4a91bb1f223330b6d8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:40.025411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:40.101974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1249/2472] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:41.258469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:41.323987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd572be-ee75-4659-b4ae-f7497aec00fd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:41.329037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:41.329951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:41.330265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:41.330567 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] PATH_INFO: `/v3/users/a3c02fd4e0c24e8a8b9b7b055ce56654` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:41.331826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c02fd4e0c24e8a8b9b7b055ce56654)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:41.333810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:41.347952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:41.384341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c02fd4e0c24e8a8b9b7b055ce56654'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.391305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c02fd4e0c24e8a8b9b7b055ce56654'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.391969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c02fd4e0c24e8a8b9b7b055ce56654'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.401244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c02fd4e0c24e8a8b9b7b055ce56654'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.401913 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c02fd4e0c24e8a8b9b7b055ce56654'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.419419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1224/2473] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:41 2022] DELETE /identity/v3/users/a3c02fd4e0c24e8a8b9b7b055ce56654 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:41.610078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:41.622039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54182d-694c-4bbb-bf2c-5999ff5eb324 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:41.681258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:41.682187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:41.682476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:41.682743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] PATH_INFO: `/v3/projects/285ecdb759364badbb678326891e9e01` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:41.683982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285ecdb759364badbb678326891e9e01)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:41.686535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:41.742491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285ecdb759364badbb678326891e9e01', 'request_id': 'req-e60ebc1d-31b5-4eb5-a072-529f72760f32'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.751056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285ecdb759364badbb678326891e9e01', 'request_id': 'req-e60ebc1d-31b5-4eb5-a072-529f72760f32'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.757466 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285ecdb759364badbb678326891e9e01', 'request_id': 'req-e60ebc1d-31b5-4eb5-a072-529f72760f32'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.765062 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:41.768960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] The token cache is being invalidate because project 285ecdb759364badbb678326891e9e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:41.769312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.770386 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.772092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1250/2474] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:41 2022] DELETE /identity/v3/projects/285ecdb759364badbb678326891e9e01 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:41.776093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:41.777588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:41.790589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40f14e-c80a-4cf8-9f4d-edb7f2ba3229 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:41.848582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:41.849469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:41.849803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:41.850098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] PATH_INFO: `/v3/users/9b294c3e99ef4a91bb1f223330b6d8a5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:41.851453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b294c3e99ef4a91bb1f223330b6d8a5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:41.853428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:41.907933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b294c3e99ef4a91bb1f223330b6d8a5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.915644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b294c3e99ef4a91bb1f223330b6d8a5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.915945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b294c3e99ef4a91bb1f223330b6d8a5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.924182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b294c3e99ef4a91bb1f223330b6d8a5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.924795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e4dd9f66-9018-4922-9168-725f006668a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b294c3e99ef4a91bb1f223330b6d8a5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:41.941885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1225/2475] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:41 2022] DELETE /identity/v3/users/9b294c3e99ef4a91bb1f223330b6d8a5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:42.115244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.116805 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:42.129591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebc1d-31b5-4eb5-a072-529f72760f32 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.188263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.189061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.189347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.189638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] PATH_INFO: `/v3/projects/341349b2d80740cda16cc16a3749a36b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.191481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=341349b2d80740cda16cc16a3749a36b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.192797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.241510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341349b2d80740cda16cc16a3749a36b', 'request_id': 'req-01549cc1-4962-4bc7-8ec8-0fa7944cc868'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:42.249010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341349b2d80740cda16cc16a3749a36b', 'request_id': 'req-01549cc1-4962-4bc7-8ec8-0fa7944cc868'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:42.255459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341349b2d80740cda16cc16a3749a36b', 'request_id': 'req-01549cc1-4962-4bc7-8ec8-0fa7944cc868'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:42.267113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] The token cache is being invalidate because project 341349b2d80740cda16cc16a3749a36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:42.267316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:42.268080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-01549cc1-4962-4bc7-8ec8-0fa7944cc868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:42.269927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1251/2476] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:42 2022] DELETE /identity/v3/projects/341349b2d80740cda16cc16a3749a36b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:42.275047 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.275565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.275565 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.297489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:42.299334 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:42.306027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:42.380649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1226/2477] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:42.388514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.389375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.389623 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.410767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:42.412184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:42.432387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1252/2478] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:42.436696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.446971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d187fd-d592-4a7a-954a-e46fc3f285c3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.451579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.452232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.452514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.452789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.453521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:01:42.453849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.455466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.468548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1227/2479] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:01:42.474944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.489459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fe945-00b8-4ba9-8c9a-f13ad19d5081 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.498179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.498943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.499292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.499568 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.500271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.502243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.532660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1253/2480] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:42 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:42.538952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.554893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d081cb-1d6d-4ce5-901f-5b3c4ac9a216 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.627256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.627940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.628231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.628512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.629213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.631197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.655051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1228/2481] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:42 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:42.659377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.670297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5f0b-3460-42b5-8761-815bfdc592a0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.675486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.676143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.676429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.676710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.677450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.679096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.689833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1254/2482] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:42.694564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.711025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe4db-323c-40b6-b1f6-bffc4ac220f2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.718603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb088d17-c1d7-45cc-b8ce-5e541010ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.719255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb088d17-c1d7-45cc-b8ce-5e541010ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.719541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb088d17-c1d7-45cc-b8ce-5e541010ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.719818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb088d17-c1d7-45cc-b8ce-5e541010ac83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.720590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb088d17-c1d7-45cc-b8ce-5e541010ac83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.722302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb088d17-c1d7-45cc-b8ce-5e541010ac83 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.733684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1229/2483] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:42.737937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.748442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d519-d970-4e92-976d-9d9431bbe60c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.753632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.754548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.754840 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.755114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] PATH_INFO: `/v3/projects/ebf9b40b6a964f65a889aed3b4df3e58/users/e84fe30c55f34b52ab4920f8c2eb8433/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.770300 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf9b40b6a964f65a889aed3b4df3e58, user_id=e84fe30c55f34b52ab4920f8c2eb8433, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.772960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:42.788268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1255/2484] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:42 2022] PUT /identity/v3/projects/ebf9b40b6a964f65a889aed3b4df3e58/users/e84fe30c55f34b52ab4920f8c2eb8433/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:42.798973 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.799406 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.799791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.828292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] MFA Rules not processed for user `e84fe30c55f34b52ab4920f8c2eb8433`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:42.829574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:42.896989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1230/2485] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:42.901803 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:42.933952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:42.967579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc5b1-cc65-471e-a8f7-2ffdf6a6572a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:42.972564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:42.973194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:42.973481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:42.973864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:42.974563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:42.976503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.005329 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1256/2486] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:42 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:43.011103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.018272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:43.023165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86097755-7f2d-4ba6-abd0-4c35847bc985 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.081784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.082452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.082739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.083017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.083724 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.085730 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.107857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1231/2487] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:43 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:43.113191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.124009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485bd5f-41d9-4429-878b-4881c8accce7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.129966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.130630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.130910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.131189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.131989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.133631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.144531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1257/2488] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:43.148680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.159040 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5674f-030e-48f9-890b-d93afb79f141 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.163948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.164834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.165118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.165394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] PATH_INFO: `/v3/projects/a566ccc2d17e4b04981895e337b94f32/users/50772824063f4dbe8b05e994338552eb/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.181030 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a566ccc2d17e4b04981895e337b94f32, user_id=50772824063f4dbe8b05e994338552eb, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.183821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.197969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1232/2489] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:43 2022] PUT /identity/v3/projects/a566ccc2d17e4b04981895e337b94f32/users/50772824063f4dbe8b05e994338552eb/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:43.202082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.212267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043f8f-4e82-43b2-a53b-0c7c7da9d41c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.272025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9c79-07cb-4dd7-b630-69521c01eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.272684 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9c79-07cb-4dd7-b630-69521c01eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.272965 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9c79-07cb-4dd7-b630-69521c01eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.273247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9c79-07cb-4dd7-b630-69521c01eb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.274032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d9c79-07cb-4dd7-b630-69521c01eb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.275745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d9c79-07cb-4dd7-b630-69521c01eb6c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.289517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1258/2490] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:43.293812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.304440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a4e6-57cf-4d53-bbe4-7b4966539be7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.309141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.310052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.310649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.310772 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] PATH_INFO: `/v3/projects/a566ccc2d17e4b04981895e337b94f32/users/50772824063f4dbe8b05e994338552eb/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.312715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a566ccc2d17e4b04981895e337b94f32, user_id=50772824063f4dbe8b05e994338552eb, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.315399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.326037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1233/2491] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:43 2022] PUT /identity/v3/projects/a566ccc2d17e4b04981895e337b94f32/users/50772824063f4dbe8b05e994338552eb/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:43.338091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.338435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.338717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.376911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] MFA Rules not processed for user `50772824063f4dbe8b05e994338552eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:43.378337 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:43.461330 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1259/2492] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:43.475513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.477579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:43.565846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd6a8-2710-4536-bc52-dcfbe9370906 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.571650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1245-e072-4fda-957f-966853cf569c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.572316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1245-e072-4fda-957f-966853cf569c service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.572598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1245-e072-4fda-957f-966853cf569c service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.572868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1245-e072-4fda-957f-966853cf569c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.584354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1245-e072-4fda-957f-966853cf569c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.585863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b1245-e072-4fda-957f-966853cf569c service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.596465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1234/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:43.668594 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.695448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:43.734685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbcac-ddb3-4efd-841c-734be8fcc847 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:43.739574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:43.740462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.740746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.741024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] PATH_INFO: `/v3/users/e84fe30c55f34b52ab4920f8c2eb8433` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.742256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84fe30c55f34b52ab4920f8c2eb8433)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:43.744198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:43.799469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84fe30c55f34b52ab4920f8c2eb8433'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:43.808875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84fe30c55f34b52ab4920f8c2eb8433'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:43.816218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84fe30c55f34b52ab4920f8c2eb8433'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:43.816892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84fe30c55f34b52ab4920f8c2eb8433'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:43.829096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84fe30c55f34b52ab4920f8c2eb8433'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:43.834944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1260/2494] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:43 2022] DELETE /identity/v3/users/e84fe30c55f34b52ab4920f8c2eb8433 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:43.839709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:43.840000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:43.840280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:43.860620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:43.861880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:43.901757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:43.929948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1235/2495] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:43.940544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:43.942035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:44.004362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6678c-803a-49c8-9567-ebf5b545dfbd admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:44.008000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:44.008659 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:44.008940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:44.009215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:44.018937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:44.020372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:44.030726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1261/2496] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:44.384719 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:44.386284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:44.400265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b6a7-529f-401f-a514-f95c46218422 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:44.405761 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:44.407160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:44.407610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:44.407891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] PATH_INFO: `/v3/projects/ebf9b40b6a964f65a889aed3b4df3e58` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:44.409186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf9b40b6a964f65a889aed3b4df3e58)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:44.411196 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:44.459327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf9b40b6a964f65a889aed3b4df3e58', 'request_id': 'req-15957a11-fd8c-4101-819c-9b8ac3010eb4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.467643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf9b40b6a964f65a889aed3b4df3e58', 'request_id': 'req-15957a11-fd8c-4101-819c-9b8ac3010eb4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.473870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf9b40b6a964f65a889aed3b4df3e58', 'request_id': 'req-15957a11-fd8c-4101-819c-9b8ac3010eb4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.484516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] The token cache is being invalidate because project ebf9b40b6a964f65a889aed3b4df3e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:44.484803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.485418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.487016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1236/2497] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:44 2022] DELETE /identity/v3/projects/ebf9b40b6a964f65a889aed3b4df3e58 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:44.491093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:44.501020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e752-ade6-4b82-91ae-a3e708811143 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:44.542583 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:44.560347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:44.561270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:44.561558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:44.561874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] PATH_INFO: `/v3/users/50772824063f4dbe8b05e994338552eb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:44.563110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50772824063f4dbe8b05e994338552eb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:44.565040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:44.619002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50772824063f4dbe8b05e994338552eb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.628567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50772824063f4dbe8b05e994338552eb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.639917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50772824063f4dbe8b05e994338552eb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.640658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50772824063f4dbe8b05e994338552eb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.654051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6a714cd6-8b1a-4cae-9f11-6961e7a8b9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50772824063f4dbe8b05e994338552eb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:44.660418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1262/2498] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:44 2022] DELETE /identity/v3/users/50772824063f4dbe8b05e994338552eb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:44.942575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:44.944063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:44.959161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957a11-fd8c-4101-819c-9b8ac3010eb4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.021437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.022355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.022644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.022912 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] PATH_INFO: `/v3/projects/a566ccc2d17e4b04981895e337b94f32` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.024174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a566ccc2d17e4b04981895e337b94f32)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.026141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.077876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a566ccc2d17e4b04981895e337b94f32', 'request_id': 'req-fc180603-f3ef-4154-b2a9-e28eb806f997'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:45.087947 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a566ccc2d17e4b04981895e337b94f32', 'request_id': 'req-fc180603-f3ef-4154-b2a9-e28eb806f997'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:45.094696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a566ccc2d17e4b04981895e337b94f32', 'request_id': 'req-fc180603-f3ef-4154-b2a9-e28eb806f997'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:45.098968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:45.106667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] The token cache is being invalidate because project a566ccc2d17e4b04981895e337b94f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:45.107116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:45.108622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fc180603-f3ef-4154-b2a9-e28eb806f997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:45.110262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1237/2499] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:44 2022] DELETE /identity/v3/projects/a566ccc2d17e4b04981895e337b94f32 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:45.115338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.115817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.115817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.133967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:45.135221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:45.199032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1263/2500] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:01:45.212726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.213022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.213306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.233320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:45.234619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:45.244148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1238/2501] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:45.248615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.259453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01039fa-f506-4467-80c9-50b6b65317d6 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.265023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.265752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.266039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.266309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.267044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:01:45.267357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.268979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.285309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1264/2502] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:01:45.290857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.301168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf073-e220-4f8a-b043-27504b77df5c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.306221 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.306849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.307135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.307413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.308122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.310144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.340256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1239/2503] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:45.345015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.355511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776ff4-baa8-406b-a871-5c7fcfe0ac41 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.405401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:45.418511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.419175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.419517 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.419836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.420572 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.422575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.444987 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1265/2504] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:45.449100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.460630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ba53-5f75-4777-b3de-2374b670ef25 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.466321 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.466990 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.467269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.467544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.468289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.469937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.480998 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1240/2505] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:45.486160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.500947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a3207-2750-4497-98c8-aa5777cb9ecd admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.506940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb1b3-d874-4fcb-92d7-ed247ff579a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.507600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb1b3-d874-4fcb-92d7-ed247ff579a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.507883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb1b3-d874-4fcb-92d7-ed247ff579a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.508162 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb1b3-d874-4fcb-92d7-ed247ff579a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.508899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fb1b3-d874-4fcb-92d7-ed247ff579a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.510543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fb1b3-d874-4fcb-92d7-ed247ff579a3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.521316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1266/2506] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:01:45.525412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.538942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23806c-8593-4a98-850c-64b2a798e31e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.548337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.549832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.550278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.550725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] PATH_INFO: `/v3/projects/1a218b645c1e4300846b55d8fb2af2ac/users/7bcfded2ee6f491387e4e9db6b469c67/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.573743 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a218b645c1e4300846b55d8fb2af2ac, user_id=7bcfded2ee6f491387e4e9db6b469c67, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.576630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.594276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1241/2507] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:45 2022] PUT /identity/v3/projects/1a218b645c1e4300846b55d8fb2af2ac/users/7bcfded2ee6f491387e4e9db6b469c67/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:45.606194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.606497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.606775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.637806 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] MFA Rules not processed for user `7bcfded2ee6f491387e4e9db6b469c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:45.639038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:45.706102 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1267/2508] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:45.711027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.781838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19ce9-2961-4bf2-b7c0-5210fbe72478 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.787594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b632cb4-d77c-45b5-b465-a8b2a2c43565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.788269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632cb4-d77c-45b5-b465-a8b2a2c43565 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.788558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632cb4-d77c-45b5-b465-a8b2a2c43565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.788839 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632cb4-d77c-45b5-b465-a8b2a2c43565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.789535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b632cb4-d77c-45b5-b465-a8b2a2c43565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.791508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b632cb4-d77c-45b5-b465-a8b2a2c43565 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.822751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1242/2509] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:45.827011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.839012 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c7bb3-bdb4-48cd-939f-9dadbfc01927 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.849027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.849449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.850120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.875835 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:45.877215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:45.898813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.899731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.900105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.900475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.901367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.903454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.928798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1268/2510] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:45.932889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.941476 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1243/2511] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 23 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:01:45.946114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f714f9-7e46-429b-a64a-9c5d519613e1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:45.951873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:45.952629 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:45.953077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:45.953579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:45.954291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:45.957036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.958499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:45.960478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:45.980740 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1269/2512] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:01:45.984878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:45.985682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:45.995415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc22921-9560-444a-8888-cdd10b600a55 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:46.000454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:46.001382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.001693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.002022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] PATH_INFO: `/v3/projects/a68089e6804c46ffa0debd9f18dc1b88/users/4047b2bc96204089bb771fea2ef3d35a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.017264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68089e6804c46ffa0debd9f18dc1b88, user_id=4047b2bc96204089bb771fea2ef3d35a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:46.019960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:46.033546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1270/2513] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:45 2022] PUT /identity/v3/projects/a68089e6804c46ffa0debd9f18dc1b88/users/4047b2bc96204089bb771fea2ef3d35a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:01:46.037420 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:46.039399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e718-cd1c-43df-aeee-5f05abca347d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:46.050680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:46.099459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:46.100116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.100223 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882885e0-bde5-4cd1-90f2-bba9c6c59dc6 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:46.100402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.100678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.105142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:46.105960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.106251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.106533 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.107778 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:46.109397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:46.120021 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1271/2514] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:46.124148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:46.134427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bba7c-bc56-435c-ad16-b8e05f35fb49 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:46.139738 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93107a-bc98-4565-b13c-1961a4adcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:46.140655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93107a-bc98-4565-b13c-1961a4adcbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.140943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93107a-bc98-4565-b13c-1961a4adcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.141222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93107a-bc98-4565-b13c-1961a4adcbe7 admin admin] PATH_INFO: `/v3/projects/a68089e6804c46ffa0debd9f18dc1b88/users/4047b2bc96204089bb771fea2ef3d35a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.143341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93107a-bc98-4565-b13c-1961a4adcbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68089e6804c46ffa0debd9f18dc1b88, user_id=4047b2bc96204089bb771fea2ef3d35a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:46.146026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93107a-bc98-4565-b13c-1961a4adcbe7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:46.156696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1272/2515] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:46 2022] PUT /identity/v3/projects/a68089e6804c46ffa0debd9f18dc1b88/users/4047b2bc96204089bb771fea2ef3d35a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:46.158591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:46.160204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:46.166888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.167179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.167461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.168992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1244/2516] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 12:01:46.195407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] MFA Rules not processed for user `4047b2bc96204089bb771fea2ef3d35a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:46.196669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:46.268503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1273/2517] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:01:46.280460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:46.281938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:46.342904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f8f4-9d41-41cc-ac21-48f14578b03c service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:46.360589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:46.395272 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:46.396214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.396510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.396785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.406158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:46.407605 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:46.417374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1245/2518] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:01:46.467269 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:46.468707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:46.480974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f2864-8e4c-4687-ba31-cba8a7d06c71 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:46.485298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b147fc-2927-4f12-a3b0-caf4f60c58bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:46.486000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b147fc-2927-4f12-a3b0-caf4f60c58bf service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:46.486283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b147fc-2927-4f12-a3b0-caf4f60c58bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:46.486554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b147fc-2927-4f12-a3b0-caf4f60c58bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:46.544872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b147fc-2927-4f12-a3b0-caf4f60c58bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:46.546380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b147fc-2927-4f12-a3b0-caf4f60c58bf service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:46.555889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1274/2519] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:01:49.902199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:49.967488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb168f-dca1-472e-8ce4-8ad956e140d6 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:49.972815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:49.973721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:49.974010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:49.974295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] PATH_INFO: `/v3/users/7bcfded2ee6f491387e4e9db6b469c67` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:49.975545 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcfded2ee6f491387e4e9db6b469c67)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:49.977637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:50.033637 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcfded2ee6f491387e4e9db6b469c67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.042207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcfded2ee6f491387e4e9db6b469c67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.042910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcfded2ee6f491387e4e9db6b469c67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.056304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcfded2ee6f491387e4e9db6b469c67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.057285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcfded2ee6f491387e4e9db6b469c67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.077201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1246/2520] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:49 2022] DELETE /identity/v3/users/7bcfded2ee6f491387e4e9db6b469c67 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:50.081989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:50.082481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:50.082575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:50.099833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:50.101030 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:50.116290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:50.168709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1275/2521] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:01:50.178790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:50.180445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:50.230282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:50.243919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc65b3b-b9ea-413c-91e4-1d6e45004d0f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:50.248008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:50.248680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:50.248949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:50.249224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:50.258949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:50.260454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:50.271115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1247/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:50.558794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:50.560248 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:50.576726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9cce-cac5-48d6-b206-9ba20b512e48 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:50.581297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:50.582205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:50.582486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:50.582773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] PATH_INFO: `/v3/projects/1a218b645c1e4300846b55d8fb2af2ac` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:50.583952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a218b645c1e4300846b55d8fb2af2ac)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:50.585873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:50.634459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a218b645c1e4300846b55d8fb2af2ac', 'request_id': 'req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.643064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a218b645c1e4300846b55d8fb2af2ac', 'request_id': 'req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.649617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a218b645c1e4300846b55d8fb2af2ac', 'request_id': 'req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.659952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] The token cache is being invalidate because project 1a218b645c1e4300846b55d8fb2af2ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:50.660233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.660865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.662476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1276/2523] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:50 2022] DELETE /identity/v3/projects/1a218b645c1e4300846b55d8fb2af2ac => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:01:50.666456 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:50.676093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd730-f86e-443a-bde5-7468c3bfd013 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:50.734896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:50.736292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:50.736702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:50.737096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] PATH_INFO: `/v3/users/4047b2bc96204089bb771fea2ef3d35a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:50.739167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4047b2bc96204089bb771fea2ef3d35a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:50.742042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:50.792445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4047b2bc96204089bb771fea2ef3d35a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.800216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4047b2bc96204089bb771fea2ef3d35a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.801024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4047b2bc96204089bb771fea2ef3d35a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.810164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4047b2bc96204089bb771fea2ef3d35a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.810863 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-34c43baa-359d-4193-81c2-7f01350baf33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4047b2bc96204089bb771fea2ef3d35a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:50.827950 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1248/2524] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:50 2022] DELETE /identity/v3/users/4047b2bc96204089bb771fea2ef3d35a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:51.108373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.110149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:51.123712 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3bd9-0fbe-43d8-9616-f155c2a961dd admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.183110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.183961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.184247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.184528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] PATH_INFO: `/v3/projects/a68089e6804c46ffa0debd9f18dc1b88` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.186221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68089e6804c46ffa0debd9f18dc1b88)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.188268 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.235939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:51.238849 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68089e6804c46ffa0debd9f18dc1b88', 'request_id': 'req-1a145760-999c-4094-b257-a386b182fd1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:51.247931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68089e6804c46ffa0debd9f18dc1b88', 'request_id': 'req-1a145760-999c-4094-b257-a386b182fd1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:51.254104 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68089e6804c46ffa0debd9f18dc1b88', 'request_id': 'req-1a145760-999c-4094-b257-a386b182fd1a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:51.264856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] The token cache is being invalidate because project a68089e6804c46ffa0debd9f18dc1b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:51.265176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:51.265881 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1a145760-999c-4094-b257-a386b182fd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:51.267520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1277/2525] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:51 2022] DELETE /identity/v3/projects/a68089e6804c46ffa0debd9f18dc1b88 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:51.272485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.272964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.273078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.293920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:51.295977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:51.360161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1249/2526] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:51.367990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.368285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.368566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.388709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:51.389955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:51.398112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1278/2527] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:51.402402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.408707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:51.412784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5b6b9-8ccf-44dc-ad99-26f75f3b3f5b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.419012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.420228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.420524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.420813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.421558 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:01:51.421918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.423783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.438242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1250/2528] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:01:51.442588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.452144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0b4f2-bfdc-4e6b-b807-b83733b34467 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.457407 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.458092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.458370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.458645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.459322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.461228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.491331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1279/2529] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:51.497424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.512652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15c66-0e5a-4041-8ced-c820eddab14d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.574232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.574959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.575224 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.575861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.576576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.578561 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.599765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1251/2530] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:51.603754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.614931 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb28b7-41b1-4bfa-a5a1-4ff0d29bbdc0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.619789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.620448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.620732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.621009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.621789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.623584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.634613 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1280/2531] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:51.638723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.649892 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba566-c485-4f32-b990-04fef0c56fa6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.656084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c59a-3287-4422-836f-fc468bc01eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.656749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c59a-3287-4422-836f-fc468bc01eae admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.657036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c59a-3287-4422-836f-fc468bc01eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.657314 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c59a-3287-4422-836f-fc468bc01eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.658113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896c59a-3287-4422-836f-fc468bc01eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.659732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896c59a-3287-4422-836f-fc468bc01eae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.670748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1252/2532] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:51.674879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.686571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34533fb2-8927-44ba-a2e3-aa854aa4d908 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.691479 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.692316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.692602 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.692875 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] PATH_INFO: `/v3/projects/3549eb4d04d349ef9c07535790b3e526/users/6e984bef68df4074a13ed6177cae0075/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.708231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3549eb4d04d349ef9c07535790b3e526, user_id=6e984bef68df4074a13ed6177cae0075, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.710968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.726068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1281/2533] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:51 2022] PUT /identity/v3/projects/3549eb4d04d349ef9c07535790b3e526/users/6e984bef68df4074a13ed6177cae0075/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:51.737842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.738154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.738419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.767322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] MFA Rules not processed for user `6e984bef68df4074a13ed6177cae0075`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:51.768620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:51.836430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1253/2534] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:51.841837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.915959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ddb4-c9b2-4cdb-980d-873fc30d87f7 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:51.920834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:51.921492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:51.921813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:51.922094 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:51.922795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:51.924708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:51.952460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1282/2535] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:51.956669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:51.967584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb93e8-4820-43ff-9294-fc6a753b907e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.026901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.027572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.027857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.028139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.028909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.030941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.037781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:52.054870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1254/2536] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:51 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:01:52.058892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:52.069347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6d47c-5f7e-44f9-9796-5d35abdb0a91 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.074401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.075065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.075450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.075685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.076571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.078218 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.088795 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1283/2537] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:52.093071 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:52.103384 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd6b03-0226-45db-9074-5e3935784a0a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.108621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.109492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.109810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.110080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] PATH_INFO: `/v3/projects/394cb948aeb8410ba8e003c4b6911573/users/0c27d590e5da4ed3818eab3b28e71d73/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.124906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=394cb948aeb8410ba8e003c4b6911573, user_id=0c27d590e5da4ed3818eab3b28e71d73, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.127718 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.142068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1255/2538] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:52 2022] PUT /identity/v3/projects/394cb948aeb8410ba8e003c4b6911573/users/0c27d590e5da4ed3818eab3b28e71d73/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:52.146189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:52.156606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472f59-df59-4e1f-8539-1e85a979094a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.197786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:52.214553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2448a8-3859-44e6-920f-776f9e4dab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.215158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2448a8-3859-44e6-920f-776f9e4dab41 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.215441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2448a8-3859-44e6-920f-776f9e4dab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.215718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2448a8-3859-44e6-920f-776f9e4dab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.216669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2448a8-3859-44e6-920f-776f9e4dab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.218317 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2448a8-3859-44e6-920f-776f9e4dab41 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.227896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1284/2539] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:52.232766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:52.243269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6791b-d4c2-4865-9d16-cccd7f01c3eb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.248810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.250162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.250520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.250881 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] PATH_INFO: `/v3/projects/394cb948aeb8410ba8e003c4b6911573/users/0c27d590e5da4ed3818eab3b28e71d73/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.254315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=394cb948aeb8410ba8e003c4b6911573, user_id=0c27d590e5da4ed3818eab3b28e71d73, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.257795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.272410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1256/2540] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:52 2022] PUT /identity/v3/projects/394cb948aeb8410ba8e003c4b6911573/users/0c27d590e5da4ed3818eab3b28e71d73/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:01:52.283494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.283786 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.284071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.312208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] MFA Rules not processed for user `0c27d590e5da4ed3818eab3b28e71d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:52.313404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:52.387109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1285/2541] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:52.398048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:52.399946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:52.458962 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b899f-b51c-481e-b7f8-7b4a8c1140eb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.463716 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.464373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.464693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.464910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.475992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.477457 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.487890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1257/2542] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:52.588741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:52.599332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4670d-f66e-49e4-bfcf-5f24fb5810a7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:52.603949 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26992-a86a-4637-b212-702c1d174f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:52.604642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26992-a86a-4637-b212-702c1d174f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:52.604967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26992-a86a-4637-b212-702c1d174f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:52.605249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26992-a86a-4637-b212-702c1d174f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:52.666485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc26992-a86a-4637-b212-702c1d174f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:52.668022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc26992-a86a-4637-b212-702c1d174f7c service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:52.677796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1286/2543] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:01:55.267292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:55.334753 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036a2a7-09d0-4894-8b53-926564ac7de2 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:55.340534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:55.341479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:55.341799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:55.342078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] PATH_INFO: `/v3/users/6e984bef68df4074a13ed6177cae0075` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:55.343426 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e984bef68df4074a13ed6177cae0075)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:55.345423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:55.395878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e984bef68df4074a13ed6177cae0075'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.403014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e984bef68df4074a13ed6177cae0075'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.403952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e984bef68df4074a13ed6177cae0075'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.406072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:55.413531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e984bef68df4074a13ed6177cae0075'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.414535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e984bef68df4074a13ed6177cae0075'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.432541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1258/2544] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:55 2022] DELETE /identity/v3/users/6e984bef68df4074a13ed6177cae0075 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:55.437454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:55.438024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:55.438024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:55.456091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:55.457285 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:55.519768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1287/2545] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:55.530317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:55.531989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:55.594160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ca1fe-6e64-4223-965a-aed91f40f134 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:55.598239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:55.598896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:55.599228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:55.599577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:55.609877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:55.611327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:55.620921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1259/2546] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:01:55.903912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:55.905421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:55.914318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:55.919481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0913cf-71df-43b8-b4d0-076c55415688 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:55.925209 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:55.926292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:55.926593 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:55.926832 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] PATH_INFO: `/v3/projects/3549eb4d04d349ef9c07535790b3e526` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:55.928047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3549eb4d04d349ef9c07535790b3e526)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:55.929994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:55.978230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3549eb4d04d349ef9c07535790b3e526', 'request_id': 'req-0f7d01e8-58a6-477b-a2c1-f97744b005ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.988227 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3549eb4d04d349ef9c07535790b3e526', 'request_id': 'req-0f7d01e8-58a6-477b-a2c1-f97744b005ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:55.994686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3549eb4d04d349ef9c07535790b3e526', 'request_id': 'req-0f7d01e8-58a6-477b-a2c1-f97744b005ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.005692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] The token cache is being invalidate because project 3549eb4d04d349ef9c07535790b3e526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:56.005978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.006680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.008279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1288/2547] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:55 2022] DELETE /identity/v3/projects/3549eb4d04d349ef9c07535790b3e526 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:56.012510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:56.023050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e16c-81c6-4f04-939a-1d40aaba0b36 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:56.082887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:56.083684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.083971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.084252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] PATH_INFO: `/v3/users/0c27d590e5da4ed3818eab3b28e71d73` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.085573 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c27d590e5da4ed3818eab3b28e71d73)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:56.087571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:56.139502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c27d590e5da4ed3818eab3b28e71d73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.146396 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c27d590e5da4ed3818eab3b28e71d73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.147069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c27d590e5da4ed3818eab3b28e71d73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.155559 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c27d590e5da4ed3818eab3b28e71d73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.156318 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-157acee9-e208-4fde-8d98-95d3b3364830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c27d590e5da4ed3818eab3b28e71d73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.168394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:56.176821 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1260/2548] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:01:56 2022] DELETE /identity/v3/users/0c27d590e5da4ed3818eab3b28e71d73 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:56.464131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:56.465627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:56.479697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d01e8-58a6-477b-a2c1-f97744b005ea admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:56.539000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:56.539870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.540150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.540424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] PATH_INFO: `/v3/projects/394cb948aeb8410ba8e003c4b6911573` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.541628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394cb948aeb8410ba8e003c4b6911573)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:56.543566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:56.592745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394cb948aeb8410ba8e003c4b6911573', 'request_id': 'req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.601831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394cb948aeb8410ba8e003c4b6911573', 'request_id': 'req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.608651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394cb948aeb8410ba8e003c4b6911573', 'request_id': 'req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.618999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] The token cache is being invalidate because project 394cb948aeb8410ba8e003c4b6911573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:01:56.619293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.619939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-4de0619d-4f26-4437-a8e9-5b66f76cd7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:01:56.621503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1289/2549] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:01:56 2022] DELETE /identity/v3/projects/394cb948aeb8410ba8e003c4b6911573 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:56.626782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.627255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.627348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.646531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:56.647725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:56.714478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1261/2550] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:01:56.724877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.725137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.725446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.746366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:56.747656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:56.756559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1290/2551] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:56.761661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:56.776644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796f61-636c-4a32-8553-cfed10dff691 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:56.783176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:56.783836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.784117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.784383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.785111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:01:56.785416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:56.787057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:56.799562 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1262/2552] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:01:56.804031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:56.814018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96ca6-9fe0-4ca4-ae77-82ac5306d2f8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:56.819710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:56.820361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.820642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.820912 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.821636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:56.823549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:56.832314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:56.852727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1291/2553] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:01:56.857266 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:56.867972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd98030-97de-4ddc-bc08-ec4a552b9092 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:56.927972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:56.928646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.928935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.929210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.929937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:56.931871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:56.954887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1263/2554] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:56 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:56.959725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:56.973291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0ea3-7c53-4d93-93bf-18e915152364 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:56.979357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:56.980032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:56.980318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:56.980592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:56.981346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:56.984089 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:56.995129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1292/2555] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:57.001238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.019373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b572da-8d17-4775-9799-cd8ee3223688 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.029740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac6120-dfcb-4b0f-b9ca-6b13a6a94acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.030418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac6120-dfcb-4b0f-b9ca-6b13a6a94acf admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.030702 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac6120-dfcb-4b0f-b9ca-6b13a6a94acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.030983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac6120-dfcb-4b0f-b9ca-6b13a6a94acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.031723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac6120-dfcb-4b0f-b9ca-6b13a6a94acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.033347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac6120-dfcb-4b0f-b9ca-6b13a6a94acf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.043809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1264/2556] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:57.048863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.065798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4832-c763-43c1-bdd1-ca4ac29dc268 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.074347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.075754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.076010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.076294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] PATH_INFO: `/v3/projects/b09413c26ad34648a3efb0a218d7719f/users/60e67a52a29c4ab79986717e0a8f9f4c/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.094136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09413c26ad34648a3efb0a218d7719f, user_id=60e67a52a29c4ab79986717e0a8f9f4c, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.098561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.119411 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1293/2557] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:57 2022] PUT /identity/v3/projects/b09413c26ad34648a3efb0a218d7719f/users/60e67a52a29c4ab79986717e0a8f9f4c/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:57.137068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.137394 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.137879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.165934 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] MFA Rules not processed for user `60e67a52a29c4ab79986717e0a8f9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:57.167171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:57.226410 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:57.245201 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1265/2558] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:57.250058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.312615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f900-ec07-42b6-ab9b-6d0bf5c79d75 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.318704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.319366 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.319654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.319930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.320628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.322614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.351731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1294/2559] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:01:57 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:57.358072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.377548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739fa83-763d-4c8a-8938-3b907e4147d9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.449933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.450691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.450951 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.451253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.451943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.453907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.475739 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1266/2560] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:01:57 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:01:57.479906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.491955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d109-fadf-4b51-83e7-ea86585eac62 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.496858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.497685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.498114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.498502 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.499246 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.500838 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.511697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1295/2561] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:57.521056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.532811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd83fe1-37b8-4066-99ce-f3289e60bcd9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.538855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.539752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.540048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.540323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] PATH_INFO: `/v3/projects/011f2b9f0934433283883b6a7ade1cee/users/5ebac6be5241429db4c62f7bb1bfc6ae/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.565910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] RBAC: Authorizing `identity:create_grant(project_id=011f2b9f0934433283883b6a7ade1cee, user_id=5ebac6be5241429db4c62f7bb1bfc6ae, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.568430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.593345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1267/2562] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:57 2022] PUT /identity/v3/projects/011f2b9f0934433283883b6a7ade1cee/users/5ebac6be5241429db4c62f7bb1bfc6ae/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:57.597369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.608388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63214779-8620-4abf-b3dd-95b0a288a6c4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.669711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f7ab-cd0b-4d22-ae3e-1a57de16ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.670385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f7ab-cd0b-4d22-ae3e-1a57de16ab32 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.670681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f7ab-cd0b-4d22-ae3e-1a57de16ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.670962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f7ab-cd0b-4d22-ae3e-1a57de16ab32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.671709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f7ab-cd0b-4d22-ae3e-1a57de16ab32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.673321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f7ab-cd0b-4d22-ae3e-1a57de16ab32 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.683741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1296/2563] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:01:57.687983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.698650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1571907-10c7-477a-9e50-37fd2ec6991e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.703930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.704817 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.705099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.705370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] PATH_INFO: `/v3/projects/011f2b9f0934433283883b6a7ade1cee/users/5ebac6be5241429db4c62f7bb1bfc6ae/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.707477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011f2b9f0934433283883b6a7ade1cee, user_id=5ebac6be5241429db4c62f7bb1bfc6ae, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.710186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.721124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1268/2564] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:01:57 2022] PUT /identity/v3/projects/011f2b9f0934433283883b6a7ade1cee/users/5ebac6be5241429db4c62f7bb1bfc6ae/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:01:57.732835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.733129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.733448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.761412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] MFA Rules not processed for user `5ebac6be5241429db4c62f7bb1bfc6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:01:57.762671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:57.775681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:57.837029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1297/2565] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:01:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:01:57.851931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:01:57.854920 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:01:57.915296 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc7cf0-1eb9-435f-9baf-6550b1d30d80 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:01:57.919866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5c10-65b2-4420-ac99-74c5e1b249d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:01:57.920604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5c10-65b2-4420-ac99-74c5e1b249d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:01:57.920887 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5c10-65b2-4420-ac99-74c5e1b249d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:01:57.921167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5c10-65b2-4420-ac99-74c5e1b249d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:01:57.981231 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c5c10-65b2-4420-ac99-74c5e1b249d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:01:57.983257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c5c10-65b2-4420-ac99-74c5e1b249d9 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:01:57.986989 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:57.997302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1269/2566] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:01:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:02.254905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:02.256532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:02.269151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e8923-92cb-484f-891d-cc015e89e539 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:02.272835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:02.273494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:02.273812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:02.274093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:02.284527 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:02.286034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:02.296540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1298/2567] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:03.164936 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:03.165503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:03.165503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:03.183185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] MFA Rules not processed for user `f5b8e8e45345409c835d5867166da134`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:03.184379 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:03.248935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1270/2568] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:03.606392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:03.609193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:03.675807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8021d1-7fb8-4488-9d49-390e12dc7b4f service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:03.679652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:03.680350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:03.680648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:03.680926 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:03.682938 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:03.693399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:03.695017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:03.704439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1299/2569] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:04.035067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:04.036661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:04.119145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e00fd-9010-4a00-8d61-6784127e4c24 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:04.125323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:04.126022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:04.126303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:04.126575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:04.129228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:04.144022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:04.145698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:04.156683 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1271/2570] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:05.985870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:05.995933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6af3d-ee31-4942-aba2-972b852765ba service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:05.999899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:06.000558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:06.000844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:06.001123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:06.002971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:06.013580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:06.015254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:06.025002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1300/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:06.753003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:06.757572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:06.861923 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930dda6-b3fa-4e0e-9de1-3529522acc8b service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:06.867590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:06.868265 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:06.868690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:06.868987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:06.870977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:06.885677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:06.887605 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2721e1-1884-4f12-9749-fde7dce43949 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:06.900613 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1272/2572] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:07.231393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:07.300928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b8ca6-af72-4e9d-abd4-771c65031235 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:07.306090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:07.306974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:07.308123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:07.308404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] PATH_INFO: `/v3/users/60e67a52a29c4ab79986717e0a8f9f4c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:07.309715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e67a52a29c4ab79986717e0a8f9f4c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:07.311651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:07.345109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:07.366219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e67a52a29c4ab79986717e0a8f9f4c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:07.375140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e67a52a29c4ab79986717e0a8f9f4c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:07.384210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e67a52a29c4ab79986717e0a8f9f4c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:07.384857 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e67a52a29c4ab79986717e0a8f9f4c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:07.396906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e67a52a29c4ab79986717e0a8f9f4c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:07.403297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1301/2573] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:07 2022] DELETE /identity/v3/users/60e67a52a29c4ab79986717e0a8f9f4c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:07.407905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:07.408233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:07.408518 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:07.426967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:07.428182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:07.441290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:07.501711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1273/2574] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:07.511441 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:07.513558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:07.573043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c324102-9435-4452-8a6b-d6c3811a7451 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:07.577445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:07.578203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:07.578555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:07.578895 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:07.588822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:07.590371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:07.601549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1302/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:07.917152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:07.918771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:07.934005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2e38-a6e9-443e-b785-9e96158898a7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:07.940612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:07.941332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:07.941775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:07.941928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] PATH_INFO: `/v3/projects/b09413c26ad34648a3efb0a218d7719f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:07.943385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09413c26ad34648a3efb0a218d7719f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:07.945351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:08.011574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09413c26ad34648a3efb0a218d7719f', 'request_id': 'req-acaa097c-ef5d-4360-bfb7-a1826e102ac6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.020000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09413c26ad34648a3efb0a218d7719f', 'request_id': 'req-acaa097c-ef5d-4360-bfb7-a1826e102ac6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.026964 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09413c26ad34648a3efb0a218d7719f', 'request_id': 'req-acaa097c-ef5d-4360-bfb7-a1826e102ac6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.038599 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] The token cache is being invalidate because project b09413c26ad34648a3efb0a218d7719f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:08.039008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.039649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.041185 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1274/2576] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:07 2022] DELETE /identity/v3/projects/b09413c26ad34648a3efb0a218d7719f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:08.045631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:08.055921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca7797-eb78-4192-ad0f-61ea55270f9b service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:08.113476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:08.114390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.114672 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.114946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] PATH_INFO: `/v3/users/5ebac6be5241429db4c62f7bb1bfc6ae` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.116130 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebac6be5241429db4c62f7bb1bfc6ae)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:08.118073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:08.165645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebac6be5241429db4c62f7bb1bfc6ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.168341 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:08.174320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebac6be5241429db4c62f7bb1bfc6ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.182442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebac6be5241429db4c62f7bb1bfc6ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.183083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebac6be5241429db4c62f7bb1bfc6ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.195655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-c56df8f9-ed44-47f8-86e4-02cd7524c851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebac6be5241429db4c62f7bb1bfc6ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.202253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1303/2577] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:08 2022] DELETE /identity/v3/users/5ebac6be5241429db4c62f7bb1bfc6ae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:02:08.493058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:08.494630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:08.519287 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa097c-ef5d-4360-bfb7-a1826e102ac6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:08.586831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:08.587725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.587987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.588261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] PATH_INFO: `/v3/projects/011f2b9f0934433283883b6a7ade1cee` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.589524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011f2b9f0934433283883b6a7ade1cee)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:08.591564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:08.639254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:08.643355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011f2b9f0934433283883b6a7ade1cee', 'request_id': 'req-b8863959-c36e-4bc6-ad44-6deedc34cfa2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.652984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011f2b9f0934433283883b6a7ade1cee', 'request_id': 'req-b8863959-c36e-4bc6-ad44-6deedc34cfa2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.660508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011f2b9f0934433283883b6a7ade1cee', 'request_id': 'req-b8863959-c36e-4bc6-ad44-6deedc34cfa2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.672577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] The token cache is being invalidate because project 011f2b9f0934433283883b6a7ade1cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:08.672869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.673516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b8863959-c36e-4bc6-ad44-6deedc34cfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:08.675369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1275/2578] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:08 2022] DELETE /identity/v3/projects/011f2b9f0934433283883b6a7ade1cee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:02:08.681547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.682096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.682198 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.701575 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:08.702873 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:08.765973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1304/2579] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:08.775590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.775815 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.776097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.796424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:08.797633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:08.806976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1276/2580] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:08.811510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:08.821592 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea780d-8190-4943-8abc-f9fcdfb632a7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:08.827169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:08.827868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.828185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.828467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.829213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:08.829530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:08.831190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:08.846481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1305/2581] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:08.848087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:08.857888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a773-a661-4182-b00f-99bcbb35f30b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:08.862752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:08.863408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.863694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.863970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.864669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:08.866635 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:08.899166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1277/2582] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:08 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:08.903836 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:08.914298 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ac42-ac11-4ee3-bad8-bffc9c81e345 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:08.971973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:08.972642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:08.972922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:08.973186 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:08.973909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:08.975837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:08.996877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1306/2583] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:08 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:02:09.001137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:09.011837 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4efde0-990b-439e-97c0-0289d3b92e61 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:09.017142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:09.017861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:09.018146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:09.018424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:09.019159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:09.020795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:09.032026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1278/2584] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:09.036001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:09.047185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8520966-ee05-43a9-88ab-f29e32e4633e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:09.053401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803c505-4a30-49fd-ad6a-b217ba7a7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:09.054103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803c505-4a30-49fd-ad6a-b217ba7a7c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:09.054396 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803c505-4a30-49fd-ad6a-b217ba7a7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:09.054678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803c505-4a30-49fd-ad6a-b217ba7a7c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:09.055440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803c505-4a30-49fd-ad6a-b217ba7a7c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:09.057463 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803c505-4a30-49fd-ad6a-b217ba7a7c16 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:09.068676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1307/2585] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:09.073332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:09.084664 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd31e8e-73b6-458b-b123-0e19e0b919ec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:09.090588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:09.091622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:09.091907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:09.092188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] PATH_INFO: `/v3/projects/e42fb4f6fa194db6b9fec593412cba2c/users/07e872554ec24e149cdacc19af4c6f2c/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:09.108594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42fb4f6fa194db6b9fec593412cba2c, user_id=07e872554ec24e149cdacc19af4c6f2c, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:09.111290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:09.126429 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1279/2586] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:09 2022] PUT /identity/v3/projects/e42fb4f6fa194db6b9fec593412cba2c/users/07e872554ec24e149cdacc19af4c6f2c/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:09.137947 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:09.138240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:09.138523 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:09.167851 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] MFA Rules not processed for user `07e872554ec24e149cdacc19af4c6f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:09.169241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:09.192126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:09.240578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1308/2587] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:09.252922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:09.255120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:09.316215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02787ee-a5b7-42dd-adea-2631e89480f4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:09.320313 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:09.320965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:09.321252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:09.321532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:09.330580 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:09.332019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:09.341460 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1280/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:12.251654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:12.253461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:12.359855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ef053-4736-442b-bc5e-3ecaa2bae3c5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:12.363674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:12.364345 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:12.364628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:12.364927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:12.366767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:12.381532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:12.383145 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608a72e-de56-4621-8763-abdff3109664 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:12.394989 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1309/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:19.336901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:22.391233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=51 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:23.923084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:24.005219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d2c8-c239-410d-862d-965c4c38b8a4 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:24.010681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:24.011576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.011861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.012137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] PATH_INFO: `/v3/users/07e872554ec24e149cdacc19af4c6f2c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.014242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e872554ec24e149cdacc19af4c6f2c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:24.016228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:24.070084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e872554ec24e149cdacc19af4c6f2c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.077566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e872554ec24e149cdacc19af4c6f2c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.078243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e872554ec24e149cdacc19af4c6f2c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.085901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e872554ec24e149cdacc19af4c6f2c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.086552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e872554ec24e149cdacc19af4c6f2c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.105440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1281/2590] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:23 2022] DELETE /identity/v3/users/07e872554ec24e149cdacc19af4c6f2c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:24.111017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.111888 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.112170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.131717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:24.133569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:24.199980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1310/2591] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:24.209833 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:24.211289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:24.270261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d494-9456-47d9-85f2-1c267667f332 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:24.273864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a966d-2477-43c9-adfc-2c1d0e397acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:24.274520 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a966d-2477-43c9-adfc-2c1d0e397acb service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.274933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a966d-2477-43c9-adfc-2c1d0e397acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.275217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a966d-2477-43c9-adfc-2c1d0e397acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.286764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a966d-2477-43c9-adfc-2c1d0e397acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:24.288220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a966d-2477-43c9-adfc-2c1d0e397acb service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:24.299358 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1282/2592] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:24.578393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:24.580175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:24.604664 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd812d-f441-4467-9ad3-5cfa9497ee12 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:24.611039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:24.612046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.612484 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.612814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] PATH_INFO: `/v3/projects/e42fb4f6fa194db6b9fec593412cba2c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.614334 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42fb4f6fa194db6b9fec593412cba2c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:24.616603 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:24.665710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42fb4f6fa194db6b9fec593412cba2c', 'request_id': 'req-b679ea1b-364a-4bc8-92de-cd9977da309f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.674974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42fb4f6fa194db6b9fec593412cba2c', 'request_id': 'req-b679ea1b-364a-4bc8-92de-cd9977da309f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.682654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42fb4f6fa194db6b9fec593412cba2c', 'request_id': 'req-b679ea1b-364a-4bc8-92de-cd9977da309f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.695746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] The token cache is being invalidate because project e42fb4f6fa194db6b9fec593412cba2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:24.696136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.696966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b679ea1b-364a-4bc8-92de-cd9977da309f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:24.698750 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1311/2593] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:24 2022] DELETE /identity/v3/projects/e42fb4f6fa194db6b9fec593412cba2c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:24.704239 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.704534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.704865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.724004 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:24.725242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:24.743717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:24.798058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1283/2594] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:24.798313 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.798689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.799067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.819962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:24.821196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:24.834350 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1312/2595] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:24.839119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:24.849354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef091d3-98e0-42aa-b389-cc1565031936 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:24.854260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:24.854939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.855230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.855530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.856331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:24.856591 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:24.858925 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:24.874868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1284/2596] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:24.876124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:24.889432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1292d5-94d5-4c24-b012-88d1974a68c1 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:24.894915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:24.895648 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:24.895882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:24.896191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:24.896864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:24.899071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:24.936751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1313/2597] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:24 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:02:24.941400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:24.951794 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf18a5-ab7e-4ae2-b359-6f4cd43b4834 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:25.011682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:25.012361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.012638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.012919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:25.013694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:25.015806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:25.037696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1285/2598] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:24 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:25.042412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:25.054112 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba854967-fcc8-4a0b-b4e1-fe4e1f2ea0c1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:25.059735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:25.060717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.061194 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.061469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:25.062286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:25.063905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:25.074598 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1314/2599] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:25.078898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:25.090430 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24da8b-20c0-4c6e-aca6-59c4fba43e9e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:25.095644 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36543e-c967-421c-bc7c-a16ed014b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:25.096319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36543e-c967-421c-bc7c-a16ed014b90f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.096607 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36543e-c967-421c-bc7c-a16ed014b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.096889 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36543e-c967-421c-bc7c-a16ed014b90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:25.097671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36543e-c967-421c-bc7c-a16ed014b90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:25.099297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36543e-c967-421c-bc7c-a16ed014b90f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:25.112403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1286/2600] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:25.115338 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:25.126319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bcd15-a3a9-45dd-be55-adc75be612ab admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:25.132052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:25.132959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.133244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.133529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] PATH_INFO: `/v3/projects/daf00712722c42a09f146c8725e73308/users/f84f937a6bc644a7b67bbda82828eadd/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:25.149425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf00712722c42a09f146c8725e73308, user_id=f84f937a6bc644a7b67bbda82828eadd, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:25.152135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:25.167019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1315/2601] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:25 2022] PUT /identity/v3/projects/daf00712722c42a09f146c8725e73308/users/f84f937a6bc644a7b67bbda82828eadd/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:02:25.172187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ff2f-19a0-459a-b5fb-28e968777746 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.172481 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ff2f-19a0-459a-b5fb-28e968777746 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.172728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ff2f-19a0-459a-b5fb-28e968777746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:25.193625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3a70ff2f-19a0-459a-b5fb-28e968777746 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:25.194940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a70ff2f-19a0-459a-b5fb-28e968777746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:25.255475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1287/2602] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:25.265498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:25.267621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:25.282555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:25.328445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510abb9-ed51-4a55-9fc0-ae8743214eec admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:25.332616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:25.333316 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.333557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.333868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:25.343604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:25.345045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:25.354730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1316/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:25.988293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:25.988712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:25.989019 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:26.021012 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] MFA Rules not processed for user `f84f937a6bc644a7b67bbda82828eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:26.022300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:26.052232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:26.103388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1288/2604] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:26.114544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:26.116041 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:26.186831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3a27-762b-4ad2-bc5a-e070eb70e706 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:26.190610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5db23-d93d-49f3-b159-0a27209363d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:26.191383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5db23-d93d-49f3-b159-0a27209363d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:26.191729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5db23-d93d-49f3-b159-0a27209363d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:26.192095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5db23-d93d-49f3-b159-0a27209363d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:26.201529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5db23-d93d-49f3-b159-0a27209363d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:26.203059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5db23-d93d-49f3-b159-0a27209363d0 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:26.212810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1317/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:27.285682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:27.287383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:27.300704 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3415-460e-4b93-a7ad-af6e35e29afa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:27.305157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:27.305830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:27.306110 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:27.306380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:27.308431 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:27.320622 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:27.322120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:27.332170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1289/2606] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:27.597243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:27.598152 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:27.598608 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:27.617472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] MFA Rules not processed for user `f84f937a6bc644a7b67bbda82828eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:27.618770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:27.631757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1318/2607] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:30.681804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:30.685202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:30.698544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53ea6-2cbb-4f43-a0ca-a0eadb7b3d4e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:30.704577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:30.705756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:30.706048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:30.706328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] PATH_INFO: `/v3/users/e50d226291da44b5a2c35f79726ff3e7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:30.707593 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50d226291da44b5a2c35f79726ff3e7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:30.709547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:30.760477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50d226291da44b5a2c35f79726ff3e7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:30.768312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50d226291da44b5a2c35f79726ff3e7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:30.769003 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50d226291da44b5a2c35f79726ff3e7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:30.777316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50d226291da44b5a2c35f79726ff3e7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:30.778098 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f92e867-b0bb-471c-800d-cf3d9b67b7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50d226291da44b5a2c35f79726ff3e7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:30.799432 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1290/2608] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:30 2022] DELETE /identity/v3/users/e50d226291da44b5a2c35f79726ff3e7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:30.990394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.009569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2780-5b4c-4f1d-a5c6-3202731b0a00 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.072401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.073275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.073559 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.073858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] PATH_INFO: `/v3/projects/fb7c88a240e740d8b74c3cc48e8dc5f6` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.075044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7c88a240e740d8b74c3cc48e8dc5f6)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.077119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.126289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7c88a240e740d8b74c3cc48e8dc5f6', 'request_id': 'req-70719b39-736b-4cbd-81ad-e26c40dd17ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:31.128956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:31.135314 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7c88a240e740d8b74c3cc48e8dc5f6', 'request_id': 'req-70719b39-736b-4cbd-81ad-e26c40dd17ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:31.142865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7c88a240e740d8b74c3cc48e8dc5f6', 'request_id': 'req-70719b39-736b-4cbd-81ad-e26c40dd17ae'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:31.153412 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] The token cache is being invalidate because project fb7c88a240e740d8b74c3cc48e8dc5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:31.153726 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:31.154496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-70719b39-736b-4cbd-81ad-e26c40dd17ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:31.156320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1319/2609] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:30 2022] DELETE /identity/v3/projects/fb7c88a240e740d8b74c3cc48e8dc5f6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:31.161163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.161466 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.161779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.180268 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:31.181510 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:31.243326 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1291/2610] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:31.251452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.251741 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.252018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.269890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:31.271103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:31.280493 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1320/2611] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:31.284734 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.294592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9a2c6-bbdc-439e-b38c-d91d7d4f2a06 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.300245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.300865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.301159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.301440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.302269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:31.302728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.304218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.318463 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1292/2612] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:31.322562 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.333318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03728350-a844-46cb-8e24-a5a1451e2c3d None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.338301 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.339069 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.339426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.339799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.340580 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.343188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.370979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1321/2613] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:31.375220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.381764 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:31.385711 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5b378-035f-4012-86d9-0bf6d2797591 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.445584 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.446292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.446578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.446851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.447527 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.449493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.472792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1293/2614] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:02:31.477078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.488190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc5252-9ce3-44c8-88fc-1fcc481f8028 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.493279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.493977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.494264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.494541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.495279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.496911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.507547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1322/2615] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:31.512405 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.523253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaaa43-86ff-47c0-836e-bfa8b1eaff90 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.528184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce6b2-fe25-41e4-adb4-61655d0ce7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.528848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce6b2-fe25-41e4-adb4-61655d0ce7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.529195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce6b2-fe25-41e4-adb4-61655d0ce7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.529549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce6b2-fe25-41e4-adb4-61655d0ce7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.530344 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce6b2-fe25-41e4-adb4-61655d0ce7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.531969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce6b2-fe25-41e4-adb4-61655d0ce7b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.542232 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1294/2616] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:31.546644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.556784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55cbf-46be-4fbb-8be7-c9ce2cd8c359 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.561777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.562668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.562958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.563236 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] PATH_INFO: `/v3/projects/8a63ca1114f44694a846899229cb55a0/users/3f5517b30f3643a89478de613eedd15f/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.580500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a63ca1114f44694a846899229cb55a0, user_id=3f5517b30f3643a89478de613eedd15f, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.583200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.598797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1323/2617] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:31 2022] PUT /identity/v3/projects/8a63ca1114f44694a846899229cb55a0/users/3f5517b30f3643a89478de613eedd15f/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:31.611572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.611874 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.612141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.639387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] MFA Rules not processed for user `3f5517b30f3643a89478de613eedd15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:31.640609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:31.708866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1295/2618] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:31.713589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.778755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a71cb4-f6f5-4a20-8b06-cb0a3665d340 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.784058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.784713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.784993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.785278 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.785994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.787927 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.814584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1324/2619] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:31.818883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.831102 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1b3b-e97c-4032-a35f-0b5890a1bcee None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.890808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.891507 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.891792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.892073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.892830 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.894758 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.922261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1296/2620] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:31 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:31.926554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.938509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4930e-d9f0-4d82-8492-33efe4b6905a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.945782 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.946469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.946882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.947169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:31.947925 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:31.949567 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:31.961151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1325/2621] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:31.965646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:31.971169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:31.977709 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88639a0a-8362-4e23-87f8-1e6258c46562 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:31.983594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:31.984517 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:31.984804 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:31.985082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] PATH_INFO: `/v3/projects/cff4cad17066477493af2f41b365f61e/users/ca1306cfb36042a1b5bf8ab5ecc1988a/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:32.001582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff4cad17066477493af2f41b365f61e, user_id=ca1306cfb36042a1b5bf8ab5ecc1988a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:32.004288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:32.020005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1297/2622] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:31 2022] PUT /identity/v3/projects/cff4cad17066477493af2f41b365f61e/users/ca1306cfb36042a1b5bf8ab5ecc1988a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:32.024140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:32.034674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e528ac-f641-4d4c-a879-3ab529447867 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:32.082589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:32.093973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5d879-f043-4f9c-ad24-dc1a0b4ca5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:32.094655 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5d879-f043-4f9c-ad24-dc1a0b4ca5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:32.094986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5d879-f043-4f9c-ad24-dc1a0b4ca5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:32.095303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5d879-f043-4f9c-ad24-dc1a0b4ca5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:32.096055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5d879-f043-4f9c-ad24-dc1a0b4ca5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:32.098046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5d879-f043-4f9c-ad24-dc1a0b4ca5bb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:32.109393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1326/2623] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:32.113694 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:32.124690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433a41-7001-4442-a5c7-2ba79d6fb5d5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:32.129959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:32.130848 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:32.131132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:32.131403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] PATH_INFO: `/v3/projects/cff4cad17066477493af2f41b365f61e/users/ca1306cfb36042a1b5bf8ab5ecc1988a/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:32.133383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff4cad17066477493af2f41b365f61e, user_id=ca1306cfb36042a1b5bf8ab5ecc1988a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:32.136450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:32.147586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1298/2624] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:32 2022] PUT /identity/v3/projects/cff4cad17066477493af2f41b365f61e/users/ca1306cfb36042a1b5bf8ab5ecc1988a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:32.158017 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:32.158433 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:32.158723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:32.186966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] MFA Rules not processed for user `ca1306cfb36042a1b5bf8ab5ecc1988a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:32.188193 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:32.261610 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1327/2625] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:32.273240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:32.275105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:32.336659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3692f8-e95b-4310-830d-b994b133e730 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:32.340633 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:32.341286 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:32.341578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:32.341901 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:32.351883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:32.353383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:32.363877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1299/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:32.437869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:32.448117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33269080-2f99-45a5-9291-aeaa440c3135 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:32.452103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b5bdb-dff5-4c3a-97f1-82d4f39d5633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:32.452749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b5bdb-dff5-4c3a-97f1-82d4f39d5633 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:32.453043 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b5bdb-dff5-4c3a-97f1-82d4f39d5633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:32.453374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b5bdb-dff5-4c3a-97f1-82d4f39d5633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:32.513349 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b5bdb-dff5-4c3a-97f1-82d4f39d5633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:32.515022 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b5bdb-dff5-4c3a-97f1-82d4f39d5633 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:32.524357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1328/2627] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:38.548485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:38.629853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063106d-5ed6-44f8-ba1b-166447f27fa3 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:38.636771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:38.637696 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:38.637987 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:38.638293 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] PATH_INFO: `/v3/users/3f5517b30f3643a89478de613eedd15f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:38.639583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5517b30f3643a89478de613eedd15f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:38.641521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:38.706011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5517b30f3643a89478de613eedd15f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:38.714495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5517b30f3643a89478de613eedd15f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:38.715226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5517b30f3643a89478de613eedd15f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:38.726202 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5517b30f3643a89478de613eedd15f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:38.726932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5517b30f3643a89478de613eedd15f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:38.733783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:38.753585 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1300/2628] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:38 2022] DELETE /identity/v3/users/3f5517b30f3643a89478de613eedd15f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:02:38.759331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:38.759852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:38.759991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:38.779093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:38.780446 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:38.855599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1329/2629] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:38.866478 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:38.868875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:38.936253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dfa96-5f6e-4834-8c42-caf86d601547 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:38.940491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:38.941818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:38.942095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:38.942708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:38.956008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:38.957455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:38.968043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1301/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:39.323026 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:39.324451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:39.343725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c63a6-83b2-4491-aa1b-b52dd0ab4f80 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:39.349123 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:39.350057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:39.350318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:39.350601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] PATH_INFO: `/v3/projects/8a63ca1114f44694a846899229cb55a0` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:39.351896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a63ca1114f44694a846899229cb55a0)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:39.353822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:39.361382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:39.408855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a63ca1114f44694a846899229cb55a0', 'request_id': 'req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.417549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a63ca1114f44694a846899229cb55a0', 'request_id': 'req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.424587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a63ca1114f44694a846899229cb55a0', 'request_id': 'req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.436727 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] The token cache is being invalidate because project 8a63ca1114f44694a846899229cb55a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:39.437131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.438000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.439600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1330/2631] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:39 2022] DELETE /identity/v3/projects/8a63ca1114f44694a846899229cb55a0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:39.443681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:39.457091 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e50d76-1119-4bcf-9820-b8a9dfff3b84 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:39.521343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:39.522346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:39.522639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:39.522946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] PATH_INFO: `/v3/users/ca1306cfb36042a1b5bf8ab5ecc1988a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:39.524337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1306cfb36042a1b5bf8ab5ecc1988a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:39.526412 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:39.580347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1306cfb36042a1b5bf8ab5ecc1988a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.588448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1306cfb36042a1b5bf8ab5ecc1988a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.589280 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1306cfb36042a1b5bf8ab5ecc1988a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.598578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1306cfb36042a1b5bf8ab5ecc1988a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.599225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55a1b1ca-8834-45fe-b97b-892ecb863036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1306cfb36042a1b5bf8ab5ecc1988a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:39.624949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1302/2632] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:39 2022] DELETE /identity/v3/users/ca1306cfb36042a1b5bf8ab5ecc1988a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:39.911398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:39.912817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:39.926615 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1d58-928f-4c1e-bad4-2cd3ef07f84e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:39.989760 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:39.990626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:39.990909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:39.991190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] PATH_INFO: `/v3/projects/cff4cad17066477493af2f41b365f61e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:39.992465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff4cad17066477493af2f41b365f61e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:39.994428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.044004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff4cad17066477493af2f41b365f61e', 'request_id': 'req-a309fd27-969e-4c2b-adf1-a1fe4ec36159'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:40.053373 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff4cad17066477493af2f41b365f61e', 'request_id': 'req-a309fd27-969e-4c2b-adf1-a1fe4ec36159'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:40.061027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff4cad17066477493af2f41b365f61e', 'request_id': 'req-a309fd27-969e-4c2b-adf1-a1fe4ec36159'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:40.074718 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] The token cache is being invalidate because project cff4cad17066477493af2f41b365f61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:40.075037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:40.075897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a309fd27-969e-4c2b-adf1-a1fe4ec36159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:40.077494 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1331/2633] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:39 2022] DELETE /identity/v3/projects/cff4cad17066477493af2f41b365f61e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:40.082612 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.082907 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.083207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.101297 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:40.102577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:40.106823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:40.165588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1303/2634] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:02:40.173645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.173946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.174230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.193514 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:40.194735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:40.203401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1332/2635] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:40.207983 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.218547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12be4cb-0b19-4bd1-826c-b3c1115b0e1e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.223353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.224009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.224299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.224578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.225311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:40.225650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.227290 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.239581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1304/2636] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:40.243928 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.253430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe51bc-849b-4d23-878e-97353782266b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.258310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.258957 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.259240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.259516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.260232 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.262157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.277117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:40.297541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1333/2637] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:40.298760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.309452 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20ede1-5ce4-40a6-8713-abd578651e7e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.369888 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.370569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.370851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.371129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.371826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.374135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.395669 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1305/2638] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:40.399813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.410884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093705-13a8-48d8-80f0-ce57d3892db5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.416658 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.417264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.417566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.417859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.418637 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.420293 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.432058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1334/2639] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:40.436355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.446387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40335ad9-0c32-4fb1-a4c7-6876da3855f9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.451403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafb08-8778-4a9d-b469-4aa69e6ef99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.452084 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafb08-8778-4a9d-b469-4aa69e6ef99f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.452349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafb08-8778-4a9d-b469-4aa69e6ef99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.452614 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafb08-8778-4a9d-b469-4aa69e6ef99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.453350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccafb08-8778-4a9d-b469-4aa69e6ef99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.455011 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccafb08-8778-4a9d-b469-4aa69e6ef99f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.465215 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1306/2640] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:02:40.469524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.479939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8fab8-21bf-413e-85f0-1e155c607638 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.486247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.487155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.487526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.487704 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] PATH_INFO: `/v3/projects/ccfa257e470d4db990281316c10ed1eb/users/2b8b4a0f40e64b98af764aadaa2cdbe3/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.502877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfa257e470d4db990281316c10ed1eb, user_id=2b8b4a0f40e64b98af764aadaa2cdbe3, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.505504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.522816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1335/2641] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:40 2022] PUT /identity/v3/projects/ccfa257e470d4db990281316c10ed1eb/users/2b8b4a0f40e64b98af764aadaa2cdbe3/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:40.534640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.534928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.535207 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.563058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] MFA Rules not processed for user `2b8b4a0f40e64b98af764aadaa2cdbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:40.564329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:40.633096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1307/2642] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:40.637798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.699941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376762d-81df-4804-bee1-5f8f9544a1fc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.705031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.705699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.705999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.706272 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.706967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.708891 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.737004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1336/2643] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:40.741222 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.748273 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:40.753461 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbeb62-44ba-4f22-9fcf-46f3e8c3398e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.815797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.816465 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.816748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.817028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.817769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.819819 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.843354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1308/2644] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:40.848976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.861090 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddc3ee-787b-4db1-a067-59a4cfbe9447 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.866275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.866945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.867231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.867487 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.868250 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.869952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.880858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1337/2645] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:40.885116 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.895515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f638c-a25b-42da-b7e9-5bc28b46f0de admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.900770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcae2d5-943c-4155-b0da-48b9b9e8fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.901434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcae2d5-943c-4155-b0da-48b9b9e8fa5d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.901756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcae2d5-943c-4155-b0da-48b9b9e8fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.902037 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcae2d5-943c-4155-b0da-48b9b9e8fa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.902766 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcae2d5-943c-4155-b0da-48b9b9e8fa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.904727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcae2d5-943c-4155-b0da-48b9b9e8fa5d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.915355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1309/2646] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:40.919802 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:40.930425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa600c-9c02-4c71-924e-99a56215cdf4 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:40.936010 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:40.936998 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.937375 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.937755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] PATH_INFO: `/v3/projects/910c9699f24d44a0a2bfa341a482627f/users/c7efe87cc0c64a559cd4a4b8bdd35dc3/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:40.953689 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] RBAC: Authorizing `identity:create_grant(project_id=910c9699f24d44a0a2bfa341a482627f, user_id=c7efe87cc0c64a559cd4a4b8bdd35dc3, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:40.956452 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:40.973937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1338/2647] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:40 2022] PUT /identity/v3/projects/910c9699f24d44a0a2bfa341a482627f/users/c7efe87cc0c64a559cd4a4b8bdd35dc3/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:02:40.985657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:40.985959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:40.986257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.015765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] MFA Rules not processed for user `c7efe87cc0c64a559cd4a4b8bdd35dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:41.017073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:41.087587 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1310/2648] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:41.092923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.158763 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e1a5d-c7a1-4ce4-bbb1-036541ec314e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.163571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.164265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.164544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.164845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.165554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.167482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.182036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:41.197638 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1339/2649] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:41 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:02:41.201013 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.213134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03f554-f43b-412f-9123-56ebc2048d03 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.274092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.274780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.275066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.275343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.276079 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.278132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.299032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1311/2650] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:41 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:41.303327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.315136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a61fd-4737-454a-8136-6ecdd335c418 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.319943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.320617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.320909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.321191 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.321968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.323589 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.334668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1340/2651] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:02:41.339026 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.344568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:41.350838 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff131e-a9f7-416f-af84-654acbe0897c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.355979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.356938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.357586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.357873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] PATH_INFO: `/v3/projects/84d2462b0697411db843f41f00442740/users/cf06641456ae477e819aefd990b89a1a/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.374121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d2462b0697411db843f41f00442740, user_id=cf06641456ae477e819aefd990b89a1a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.376945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.394382 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1312/2652] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:41 2022] PUT /identity/v3/projects/84d2462b0697411db843f41f00442740/users/cf06641456ae477e819aefd990b89a1a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:41.398215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.408245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d71cb-de0f-4b63-a8f0-1c281d442718 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.465436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc8478-f5fc-4da5-b777-5b313b4fa82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.466036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc8478-f5fc-4da5-b777-5b313b4fa82d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.466542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc8478-f5fc-4da5-b777-5b313b4fa82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.466822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc8478-f5fc-4da5-b777-5b313b4fa82d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.467569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc8478-f5fc-4da5-b777-5b313b4fa82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.469185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc8478-f5fc-4da5-b777-5b313b4fa82d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.479731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1341/2653] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:02:41.484401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.499504 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7828d6-222a-4770-8b75-23a83fe8958b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.504338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.505264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.505547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.505857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] PATH_INFO: `/v3/projects/84d2462b0697411db843f41f00442740/users/cf06641456ae477e819aefd990b89a1a/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.507820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d2462b0697411db843f41f00442740, user_id=cf06641456ae477e819aefd990b89a1a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.510549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.521924 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1313/2654] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:41 2022] PUT /identity/v3/projects/84d2462b0697411db843f41f00442740/users/cf06641456ae477e819aefd990b89a1a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:41.533544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16aa8a-4ea1-45be-841a-0136da11428c None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.533937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16aa8a-4ea1-45be-841a-0136da11428c None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.534289 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16aa8a-4ea1-45be-841a-0136da11428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.566100 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8a16aa8a-4ea1-45be-841a-0136da11428c None None] MFA Rules not processed for user `cf06641456ae477e819aefd990b89a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:41.567503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8a16aa8a-4ea1-45be-841a-0136da11428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:41.644657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1342/2655] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:41.655790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:41.657631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:41.716824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40e0d0-16c8-4e34-87f9-503a62ed6939 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:41.721105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:41.721792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:41.722085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:41.722362 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:41.732448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:41.733937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:41.746921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1314/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:42.119941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:42.120485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:42.120485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:42.139149 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] MFA Rules not processed for user `f84f937a6bc644a7b67bbda82828eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:42.140403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:42.199815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1343/2657] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:42.271474 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:42.272921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:42.284349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83c929-1079-408b-8ffb-4e48eb142a4c service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:42.287918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:42.288566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:42.288853 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:42.289134 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:42.352458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:42.353982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:42.364130 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1315/2658] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:46.448384 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:46.458607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e14c1-c208-4b98-9438-0ab99f2d1966 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:46.463136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a67927-2ae7-40f0-8eb8-7a76cd860e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:46.463900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a67927-2ae7-40f0-8eb8-7a76cd860e02 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:46.464241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a67927-2ae7-40f0-8eb8-7a76cd860e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:46.464581 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a67927-2ae7-40f0-8eb8-7a76cd860e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:46.473436 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:46.534368 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a67927-2ae7-40f0-8eb8-7a76cd860e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:46.535942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a67927-2ae7-40f0-8eb8-7a76cd860e02 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:46.545736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1344/2659] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:48.702067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:48.790118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313f51-93ef-464d-b6f4-44a1e8159434 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:48.799068 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:48.799981 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:48.800270 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:48.800942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] PATH_INFO: `/v3/users/2b8b4a0f40e64b98af764aadaa2cdbe3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:48.802153 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8b4a0f40e64b98af764aadaa2cdbe3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:48.804603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:48.812775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:48.863778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8b4a0f40e64b98af764aadaa2cdbe3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:48.871491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8b4a0f40e64b98af764aadaa2cdbe3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:48.872680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8b4a0f40e64b98af764aadaa2cdbe3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:48.882174 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8b4a0f40e64b98af764aadaa2cdbe3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:48.882777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8b4a0f40e64b98af764aadaa2cdbe3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:48.899752 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1316/2660] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:48 2022] DELETE /identity/v3/users/2b8b4a0f40e64b98af764aadaa2cdbe3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:48.904399 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:48.904883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:48.904979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:48.922040 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:48.923238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:48.986124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1345/2661] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:48.995799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:48.997469 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:49.056398 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcdce0-fcab-4032-be38-49bb5943c1f7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:49.060118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:49.061000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:49.061292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:49.061570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:49.071156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:49.072598 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:49.082397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1317/2662] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:49.364398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:49.365922 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:49.379569 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5f826-3355-41fa-a413-b33927fc0817 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:49.386450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:49.394943 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:49.395225 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:49.395503 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] PATH_INFO: `/v3/projects/ccfa257e470d4db990281316c10ed1eb` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:49.396777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfa257e470d4db990281316c10ed1eb)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:49.398720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:49.447835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfa257e470d4db990281316c10ed1eb', 'request_id': 'req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.457351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfa257e470d4db990281316c10ed1eb', 'request_id': 'req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.463842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfa257e470d4db990281316c10ed1eb', 'request_id': 'req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.474296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] The token cache is being invalidate because project ccfa257e470d4db990281316c10ed1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:49.474584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.475270 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.476892 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1346/2663] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:49 2022] DELETE /identity/v3/projects/ccfa257e470d4db990281316c10ed1eb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:49.480959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:49.491666 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c235a34-22fb-47c3-a948-66da3ad2d672 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:49.551978 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:49.552856 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:49.553140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:49.553419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] PATH_INFO: `/v3/users/c7efe87cc0c64a559cd4a4b8bdd35dc3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:49.554649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7efe87cc0c64a559cd4a4b8bdd35dc3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:49.556583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:49.592842 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:49.609171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7efe87cc0c64a559cd4a4b8bdd35dc3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.616082 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7efe87cc0c64a559cd4a4b8bdd35dc3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.616869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7efe87cc0c64a559cd4a4b8bdd35dc3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.625475 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7efe87cc0c64a559cd4a4b8bdd35dc3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.626225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7efe87cc0c64a559cd4a4b8bdd35dc3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:49.644576 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1318/2664] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:49 2022] DELETE /identity/v3/users/c7efe87cc0c64a559cd4a4b8bdd35dc3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:49.923976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:49.925766 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:49.940008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdd494-8c59-43b0-93ab-31d6a76dfb8f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:49.972818 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:50.001855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:50.002732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.003016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.003290 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] PATH_INFO: `/v3/projects/910c9699f24d44a0a2bfa341a482627f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.004459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910c9699f24d44a0a2bfa341a482627f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:50.006432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:50.054522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910c9699f24d44a0a2bfa341a482627f', 'request_id': 'req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.062923 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910c9699f24d44a0a2bfa341a482627f', 'request_id': 'req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.075435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910c9699f24d44a0a2bfa341a482627f', 'request_id': 'req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.085946 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] The token cache is being invalidate because project 910c9699f24d44a0a2bfa341a482627f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:50.086249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.086889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.088478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1347/2665] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:49 2022] DELETE /identity/v3/projects/910c9699f24d44a0a2bfa341a482627f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:50.092594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:50.094171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:50.107933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf515-1b93-48b8-bdec-6b6b77ab60cc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:50.169077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:50.170241 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.170515 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.170797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] PATH_INFO: `/v3/users/cf06641456ae477e819aefd990b89a1a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.172164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf06641456ae477e819aefd990b89a1a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:50.174139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:50.225531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf06641456ae477e819aefd990b89a1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.232905 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf06641456ae477e819aefd990b89a1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.233677 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf06641456ae477e819aefd990b89a1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.244294 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf06641456ae477e819aefd990b89a1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.244992 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a21d8468-cfdb-49f3-9e46-9bc53abdf3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf06641456ae477e819aefd990b89a1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.263891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1319/2666] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:50 2022] DELETE /identity/v3/users/cf06641456ae477e819aefd990b89a1a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:50.548111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:50.549901 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:50.574651 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4073a-5aab-43a8-8a63-46b03b7cc5e5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:50.638080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:50.638952 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.639235 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.639512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] PATH_INFO: `/v3/projects/84d2462b0697411db843f41f00442740` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.640753 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d2462b0697411db843f41f00442740)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:50.642884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:50.690360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d2462b0697411db843f41f00442740', 'request_id': 'req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.699096 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d2462b0697411db843f41f00442740', 'request_id': 'req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.706322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d2462b0697411db843f41f00442740', 'request_id': 'req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.710432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:50.719129 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] The token cache is being invalidate because project 84d2462b0697411db843f41f00442740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:50.719467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.720390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-10cbbd7a-b82a-4071-b4ee-242e4f53fa0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:50.722216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1348/2667] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:50 2022] DELETE /identity/v3/projects/84d2462b0697411db843f41f00442740 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:50.728541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.728832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.729115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.748077 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:50.749418 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:50.770886 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:50.811022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1320/2668] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:50.819736 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.820031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.820310 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.846083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:50.847876 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:50.861220 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1349/2669] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:50.867021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:50.878282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca98295-06ab-4f9f-bb5f-c36cc6127a3a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:50.884401 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:50.885100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.885421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.885738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.886528 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:50.886843 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:50.888687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:50.900910 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1321/2670] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:50.905582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:50.915425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9130e4-e4f7-4260-b28f-2993d3d4be46 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:50.920747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:50.921416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:50.921745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:50.922029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:50.922735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:50.924767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:50.951979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1350/2671] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:50 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:50.957770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:50.968046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c959a0-c3e4-4281-a384-cf677bfff13e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.026809 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.027485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.027777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.028041 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.028736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.030795 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.052826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1322/2672] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:50 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:51.058973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.070864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7602fa-44fa-44df-87ef-8585dfbf2b8f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.076591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.077311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.077618 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.077900 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.078639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.080244 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.091884 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1351/2673] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:51.095872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.106627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c7ae-95ad-4eb3-8c5a-c5e799db4b49 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.112282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcfb0d-0c16-49ed-96c2-fbaca24baa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.112985 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfb0d-0c16-49ed-96c2-fbaca24baa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.113267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfb0d-0c16-49ed-96c2-fbaca24baa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.113544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfb0d-0c16-49ed-96c2-fbaca24baa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.114322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcfb0d-0c16-49ed-96c2-fbaca24baa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.115931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcfb0d-0c16-49ed-96c2-fbaca24baa36 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.126699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1323/2674] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:51.130966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.141311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74eda5-516a-471f-949a-df1c341564c1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.146132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.147045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.147327 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.147599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] PATH_INFO: `/v3/projects/02eb5d1cd3e446dca2984df9eb740b32/users/d9d1ecf2db6749c5964b753eaa0aa408/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.163011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02eb5d1cd3e446dca2984df9eb740b32, user_id=d9d1ecf2db6749c5964b753eaa0aa408, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.165695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.179702 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1352/2675] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:51 2022] PUT /identity/v3/projects/02eb5d1cd3e446dca2984df9eb740b32/users/d9d1ecf2db6749c5964b753eaa0aa408/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:51.191141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.191436 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.191725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.219855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] MFA Rules not processed for user `d9d1ecf2db6749c5964b753eaa0aa408`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:51.221086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:51.293277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1324/2676] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:51.298115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.370383 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4e935-74a2-47e2-a797-238cdeb29d52 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.377035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.377784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.378065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.378340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.379036 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.380979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.409241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1353/2677] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:51 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:51.413399 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.424707 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c98806-8838-46bd-bd29-2207568a60ca None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.443624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:51.485111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.485825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.486112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.486386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.487085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.489022 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.508927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1325/2678] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:51 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:02:51.513109 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.523790 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8dcae-12b2-4029-84de-433e39a92f70 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.528599 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.529440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.529855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.530146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.530893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.532522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.543695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1354/2679] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:51.549771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.563485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1eb5-61af-45a7-8d30-1b17ce27ddde admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.569374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.570320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.570606 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.570885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] PATH_INFO: `/v3/projects/38d29ad48a294af9a619f0de113dd67c/users/f8bef53949dd47cf94d1af484a48306c/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.586575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d29ad48a294af9a619f0de113dd67c, user_id=f8bef53949dd47cf94d1af484a48306c, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.589325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.605305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1326/2680] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:51 2022] PUT /identity/v3/projects/38d29ad48a294af9a619f0de113dd67c/users/f8bef53949dd47cf94d1af484a48306c/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:51.610046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.620192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a802e83-bcd2-44a9-bd92-591b0321e080 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.690078 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf73a8f-ad02-4c41-8f98-8b937af9f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.690668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf73a8f-ad02-4c41-8f98-8b937af9f9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.690958 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf73a8f-ad02-4c41-8f98-8b937af9f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.691241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf73a8f-ad02-4c41-8f98-8b937af9f9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.691996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf73a8f-ad02-4c41-8f98-8b937af9f9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.693617 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf73a8f-ad02-4c41-8f98-8b937af9f9bb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.698859 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:51.704622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1355/2681] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:02:51.709298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.720674 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cc2cc-24d6-494d-bb1b-fde1f2c6f49f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.726007 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.726904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.727189 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.727495 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] PATH_INFO: `/v3/projects/38d29ad48a294af9a619f0de113dd67c/users/f8bef53949dd47cf94d1af484a48306c/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.729626 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d29ad48a294af9a619f0de113dd67c, user_id=f8bef53949dd47cf94d1af484a48306c, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.732779 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.744170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1327/2682] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:51 2022] PUT /identity/v3/projects/38d29ad48a294af9a619f0de113dd67c/users/f8bef53949dd47cf94d1af484a48306c/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:51.756284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.756577 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.756862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.786515 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] MFA Rules not processed for user `f8bef53949dd47cf94d1af484a48306c`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:51.788237 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:51.864762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1356/2683] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:51.876601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:51.878414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:51.945659 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce67bb-4507-4411-993c-cd4c464ad3c7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:51.954866 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16aa99-cc5c-4dec-b718-7ba29604aa33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:51.955525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16aa99-cc5c-4dec-b718-7ba29604aa33 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:51.955803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16aa99-cc5c-4dec-b718-7ba29604aa33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:51.956078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16aa99-cc5c-4dec-b718-7ba29604aa33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:51.966242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16aa99-cc5c-4dec-b718-7ba29604aa33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:51.967851 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16aa99-cc5c-4dec-b718-7ba29604aa33 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:51.978854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1328/2684] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:52.622284 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:52.687520 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dec9c0-635d-4a80-9a6f-a65fc6fec6c0 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:52.692636 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:52.693578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:52.694075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:52.694356 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] PATH_INFO: `/v3/users/d9d1ecf2db6749c5964b753eaa0aa408` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:52.695557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d1ecf2db6749c5964b753eaa0aa408)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:52.697725 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:52.749498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d1ecf2db6749c5964b753eaa0aa408'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:52.757008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d1ecf2db6749c5964b753eaa0aa408'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:52.764601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d1ecf2db6749c5964b753eaa0aa408'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:52.765328 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d1ecf2db6749c5964b753eaa0aa408'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:52.778377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d1ecf2db6749c5964b753eaa0aa408'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:52.784688 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1357/2685] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:52 2022] DELETE /identity/v3/users/d9d1ecf2db6749c5964b753eaa0aa408 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:52.792348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:52.792348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:52.792348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:52.809188 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:52.810524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:52.871397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1329/2686] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:52.881508 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:52.883157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:52.894216 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:52.947775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddaafb-a162-49e1-b3e2-d1a7ce170595 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:52.951601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:52.952258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:52.952547 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:52.952830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:52.961942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:52.963418 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:52.972910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1358/2687] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:02:53.311115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:53.313588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:53.327928 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313029c-2c4b-42ef-bb00-99a58503a071 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:53.333307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:53.334371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:53.334564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:53.335371 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] PATH_INFO: `/v3/projects/02eb5d1cd3e446dca2984df9eb740b32` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:53.336949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02eb5d1cd3e446dca2984df9eb740b32)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:53.339555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:53.361312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:53.418444 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02eb5d1cd3e446dca2984df9eb740b32', 'request_id': 'req-55812e48-315d-43e1-b6ae-83709cbf337f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.427403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02eb5d1cd3e446dca2984df9eb740b32', 'request_id': 'req-55812e48-315d-43e1-b6ae-83709cbf337f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.434126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02eb5d1cd3e446dca2984df9eb740b32', 'request_id': 'req-55812e48-315d-43e1-b6ae-83709cbf337f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.445630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] The token cache is being invalidate because project 02eb5d1cd3e446dca2984df9eb740b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:53.445931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.446578 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.448118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1330/2688] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:53 2022] DELETE /identity/v3/projects/02eb5d1cd3e446dca2984df9eb740b32 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:53.452641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:53.462460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ffe3-de4c-42ca-837b-d3201065722e service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:53.522306 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:53.523211 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:53.523492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:53.523768 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] PATH_INFO: `/v3/users/f8bef53949dd47cf94d1af484a48306c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:53.524959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bef53949dd47cf94d1af484a48306c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:53.526937 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:53.578303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bef53949dd47cf94d1af484a48306c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.588970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bef53949dd47cf94d1af484a48306c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.596654 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bef53949dd47cf94d1af484a48306c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.597370 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bef53949dd47cf94d1af484a48306c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.610474 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-335de32c-1704-4eeb-bfef-a0131fa2ea83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bef53949dd47cf94d1af484a48306c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:53.616983 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1359/2689] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:53 2022] DELETE /identity/v3/users/f8bef53949dd47cf94d1af484a48306c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:53.900289 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:53.901995 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:53.916251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812e48-315d-43e1-b6ae-83709cbf337f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:53.977514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:53.978427 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:53.978714 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:53.978994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] PATH_INFO: `/v3/projects/38d29ad48a294af9a619f0de113dd67c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:53.980238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d29ad48a294af9a619f0de113dd67c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:53.982715 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.033624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d29ad48a294af9a619f0de113dd67c', 'request_id': 'req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:54.042450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d29ad48a294af9a619f0de113dd67c', 'request_id': 'req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:54.049144 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d29ad48a294af9a619f0de113dd67c', 'request_id': 'req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:54.059763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] The token cache is being invalidate because project 38d29ad48a294af9a619f0de113dd67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:54.060052 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:54.060748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4213cb2-2a30-4e49-b9ea-03ae49069ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:54.062363 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1331/2690] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:53 2022] DELETE /identity/v3/projects/38d29ad48a294af9a619f0de113dd67c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:54.067501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.067986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.068118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.086746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:54.087975 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:54.111291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:54.155963 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1360/2691] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:02:54.164411 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.164700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.164977 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.190785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:54.192017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:54.201738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1332/2692] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:54.206275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.217710 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765dfec-0e49-4e44-947f-3aecc2f6a842 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.223442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.224172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.224462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.224742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.225496 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:54.225862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.227507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.240476 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1361/2693] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:54.244904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.255470 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa364-08ea-4100-8ed3-5aef7f2cc206 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.261865 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.262516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.262800 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.263075 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.264063 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.266056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.297631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1333/2694] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:54.302076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.313206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098c3c-1299-4737-afe9-193cb8ea1d4b admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.371405 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.372020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.372296 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.372607 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.373468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.375438 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.397081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1362/2695] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:54.401339 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.407159 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:54.414560 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad72481-4988-4ca9-8e94-c96fc94bcc0d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.421458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.422171 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.422458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.422720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.423472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.425050 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.436488 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1334/2696] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:54.440640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.450591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e678940-69e6-40c9-b08c-c01e841f16a1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.457711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e903cc-67a5-46a0-a1ea-4c2ea3beb1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.458404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e903cc-67a5-46a0-a1ea-4c2ea3beb1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.458701 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e903cc-67a5-46a0-a1ea-4c2ea3beb1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.459011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e903cc-67a5-46a0-a1ea-4c2ea3beb1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.459793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e903cc-67a5-46a0-a1ea-4c2ea3beb1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.461392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e903cc-67a5-46a0-a1ea-4c2ea3beb1dd admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.473150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1363/2697] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:54.477472 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.488390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9fa4e-f39b-4caf-bd5e-458305cf3406 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.493579 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.494834 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.495080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.495390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] PATH_INFO: `/v3/projects/24bcced856454b7894ca3270cd474cc0/users/fc58b121685f43638bac90fd8a94b64a/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.514039 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bcced856454b7894ca3270cd474cc0, user_id=fc58b121685f43638bac90fd8a94b64a, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.517638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.536000 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1335/2698] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:54 2022] PUT /identity/v3/projects/24bcced856454b7894ca3270cd474cc0/users/fc58b121685f43638bac90fd8a94b64a/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:54.548649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.549105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.549450 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.585063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] MFA Rules not processed for user `fc58b121685f43638bac90fd8a94b64a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:54.586504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:54.670810 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1364/2699] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:54.675229 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.754220 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8ae2-49c1-4fa5-80e2-0a9faaab7921 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.759984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.760505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.760885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.761532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.762621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.765347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.806941 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1336/2700] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:54.811360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.823647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb693a75-721e-4962-9cac-d36f303e59c2 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.846667 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:54.898455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.899074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.899364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.899645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.900342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.902344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.924004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1365/2701] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:54 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:54.928801 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.943123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b410a-0494-4a78-b67a-b568deb61042 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.948097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.948778 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.949067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.949376 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:54.950120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:54.951911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:54.963440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1337/2702] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:54.967874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:54.978045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a936e56-d514-457e-8c7d-de93086e9716 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:54.983526 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:54.984447 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:54.984754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:54.985029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] PATH_INFO: `/v3/projects/b1f7f9fc7a234efe9c6c9c46d6157bb5/users/cd0d79aec47a427985af085e9952ff27/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:55.002427 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f7f9fc7a234efe9c6c9c46d6157bb5, user_id=cd0d79aec47a427985af085e9952ff27, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:55.005087 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:55.031978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1366/2703] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:54 2022] PUT /identity/v3/projects/b1f7f9fc7a234efe9c6c9c46d6157bb5/users/cd0d79aec47a427985af085e9952ff27/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:55.036244 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:55.051473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba375f1-4fcd-402b-94fc-7e5d79b8705f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:55.114113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:55.116434 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:55.138459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:55.139940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:55.140383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:55.140844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:55.142115 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:55.143906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:55.161723 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1338/2704] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:55.163373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:55.176132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705daa-193f-41ad-8e13-4a17b11107f7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:55.182057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a9c49-aede-497b-b51c-95015338a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:55.182971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9c49-aede-497b-b51c-95015338a042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:55.183563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9c49-aede-497b-b51c-95015338a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:55.183852 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9c49-aede-497b-b51c-95015338a042 admin admin] PATH_INFO: `/v3/projects/b1f7f9fc7a234efe9c6c9c46d6157bb5/users/cd0d79aec47a427985af085e9952ff27/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:55.186574 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a9c49-aede-497b-b51c-95015338a042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f7f9fc7a234efe9c6c9c46d6157bb5, user_id=cd0d79aec47a427985af085e9952ff27, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:55.190072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a9c49-aede-497b-b51c-95015338a042 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:55.205083 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1339/2705] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:55 2022] PUT /identity/v3/projects/b1f7f9fc7a234efe9c6c9c46d6157bb5/users/cd0d79aec47a427985af085e9952ff27/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:55.215346 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:55.215586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:55.215803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:55.232621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645105fb-6d41-4524-bb9b-aeff87081877 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:55.250899 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] MFA Rules not processed for user `cd0d79aec47a427985af085e9952ff27`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:55.252299 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:55.266783 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:55.324516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:55.325311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:55.325844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:55.326528 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:55.329107 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:55.341495 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:55.343402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:55.345806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1340/2706] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:55.356566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:55.358335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:55.362053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1367/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:02:55.425101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae714190-bed3-4b9c-9dca-c58ace677e36 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:55.428876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82622-e59b-4dea-b04a-c831e8f78b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:55.429541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82622-e59b-4dea-b04a-c831e8f78b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:55.429902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82622-e59b-4dea-b04a-c831e8f78b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:55.430184 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82622-e59b-4dea-b04a-c831e8f78b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:55.440776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82622-e59b-4dea-b04a-c831e8f78b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:55.442275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd82622-e59b-4dea-b04a-c831e8f78b83 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:55.453141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1341/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:02:55.997217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:56.012978 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:56.098506 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ecabb-2d52-4fd1-af57-2f30e6c957b2 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:56.103600 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:56.104691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:56.105060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:56.105344 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] PATH_INFO: `/v3/users/fc58b121685f43638bac90fd8a94b64a` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:56.106699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc58b121685f43638bac90fd8a94b64a)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:56.109546 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:56.175462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc58b121685f43638bac90fd8a94b64a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.187332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc58b121685f43638bac90fd8a94b64a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.199561 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc58b121685f43638bac90fd8a94b64a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.200477 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc58b121685f43638bac90fd8a94b64a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.217176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc58b121685f43638bac90fd8a94b64a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.224235 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1368/2709] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:55 2022] DELETE /identity/v3/users/fc58b121685f43638bac90fd8a94b64a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:56.228938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002f520-0ee5-4999-b013-790374187910 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:56.229420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002f520-0ee5-4999-b013-790374187910 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:56.229516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002f520-0ee5-4999-b013-790374187910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:56.249323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d002f520-0ee5-4999-b013-790374187910 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:56.250763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d002f520-0ee5-4999-b013-790374187910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:56.324388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1342/2710] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:56.334116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:56.335785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:56.401471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f0398-3558-4971-8662-ebd1d828947e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:56.407065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:56.407065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:56.407065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:56.407390 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:56.417439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:56.419319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:56.430394 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1369/2711] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:02:56.749380 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002f520-0ee5-4999-b013-790374187910 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:56.750971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d002f520-0ee5-4999-b013-790374187910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:56.767113 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002f520-0ee5-4999-b013-790374187910 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:56.772971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:56.773970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:56.774325 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:56.774670 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] PATH_INFO: `/v3/projects/24bcced856454b7894ca3270cd474cc0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:56.776103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bcced856454b7894ca3270cd474cc0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:56.778179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:56.830915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:56.832193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bcced856454b7894ca3270cd474cc0', 'request_id': 'req-1aebe559-b90e-4558-b825-e174736b49c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.841092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bcced856454b7894ca3270cd474cc0', 'request_id': 'req-1aebe559-b90e-4558-b825-e174736b49c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.849879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bcced856454b7894ca3270cd474cc0', 'request_id': 'req-1aebe559-b90e-4558-b825-e174736b49c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.861070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] The token cache is being invalidate because project 24bcced856454b7894ca3270cd474cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:56.861365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.862059 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:56.863760 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1343/2712] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:56 2022] DELETE /identity/v3/projects/24bcced856454b7894ca3270cd474cc0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:02:56.868346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:56.879226 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505913d-b7a4-4148-9555-e46705369314 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:56.910013 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:56.941111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:56.941966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:56.942253 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:56.942550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] PATH_INFO: `/v3/users/cd0d79aec47a427985af085e9952ff27` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:56.943777 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0d79aec47a427985af085e9952ff27)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:56.945792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.005579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0d79aec47a427985af085e9952ff27'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.022878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0d79aec47a427985af085e9952ff27'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.031685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0d79aec47a427985af085e9952ff27'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.032449 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0d79aec47a427985af085e9952ff27'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.045426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-d0f7f3c6-b126-4154-9dad-3ae01a4fb7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0d79aec47a427985af085e9952ff27'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.051799 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1370/2713] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:02:56 2022] DELETE /identity/v3/users/cd0d79aec47a427985af085e9952ff27 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:57.346615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.348157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:57.362160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe559-b90e-4558-b825-e174736b49c0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.429650 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.430568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.430927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.431355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] PATH_INFO: `/v3/projects/b1f7f9fc7a234efe9c6c9c46d6157bb5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.432688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f7f9fc7a234efe9c6c9c46d6157bb5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.434663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.463699 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.464196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.464315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.483951 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:57.484204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f7f9fc7a234efe9c6c9c46d6157bb5', 'request_id': 'req-04eea368-898c-41e8-9ed5-d1ae4132ee2b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.485179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:57.494025 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f7f9fc7a234efe9c6c9c46d6157bb5', 'request_id': 'req-04eea368-898c-41e8-9ed5-d1ae4132ee2b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.501142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f7f9fc7a234efe9c6c9c46d6157bb5', 'request_id': 'req-04eea368-898c-41e8-9ed5-d1ae4132ee2b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.513045 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] The token cache is being invalidate because project b1f7f9fc7a234efe9c6c9c46d6157bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:02:57.513543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.514100 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04eea368-898c-41e8-9ed5-d1ae4132ee2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:02:57.515672 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1344/2714] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:02:57 2022] DELETE /identity/v3/projects/b1f7f9fc7a234efe9c6c9c46d6157bb5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:57.523080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0a10-57f8-4a80-8397-c810a1f43601 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.523435 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0a10-57f8-4a80-8397-c810a1f43601 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.523721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b0a10-57f8-4a80-8397-c810a1f43601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.541862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-de5b0a10-57f8-4a80-8397-c810a1f43601 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:57.543066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-de5b0a10-57f8-4a80-8397-c810a1f43601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:57.550367 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1371/2715] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:02:57.603811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.605197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:57.610736 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1345/2716] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:02:57.618485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.618774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.619046 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.632216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:57.639288 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:57.642615 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:57.651275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1346/2717] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:02:57.655825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.662574 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:57.666170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e759-b36f-4dac-bb48-f42e707d9109 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.671247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.671909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.672190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.672681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.673250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:02:57.673531 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.675471 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.679044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a40bed-2ca5-4f2d-96f0-8ded509994ab None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.684501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.685435 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.685913 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.686295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.691145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1347/2718] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:02:57.692124 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.695200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.696789 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.701880 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a1e77-67a2-4634-87cd-cd73ed439803 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.705265 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1372/2719] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:02:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 12:02:57.706388 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.707277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.707601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.707692 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.708484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.710316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.748891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1348/2720] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:02:57 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:02:57.753143 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.764410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d8124-46c8-4172-a979-7807b66b3cba service swift] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.830430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.831118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.831422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.831775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.832371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.834322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.862359 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1373/2721] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:02:57 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:02:57.863492 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.878183 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f7205-810e-48bb-9354-8effe0693e57 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.882969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.883642 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.883897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.884167 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.884906 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.886547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.900869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1349/2722] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:02:57.902874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.914776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf66a8-8652-4b8a-943e-96a1ce5b53c3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.920168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe7291-a6ee-4f3b-906b-3b572ceeadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.920560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe7291-a6ee-4f3b-906b-3b572ceeadb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.920846 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe7291-a6ee-4f3b-906b-3b572ceeadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.921132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe7291-a6ee-4f3b-906b-3b572ceeadb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.922032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe7291-a6ee-4f3b-906b-3b572ceeadb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.923652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe7291-a6ee-4f3b-906b-3b572ceeadb0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:57.941105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1374/2723] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:02:57.942155 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:57.956911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37771102-48df-441d-99f4-69e7d7432ccb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:57.962157 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283046-289a-4409-897b-031165b27036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:57.963217 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283046-289a-4409-897b-031165b27036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:57.963501 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283046-289a-4409-897b-031165b27036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:57.963775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283046-289a-4409-897b-031165b27036 admin admin] PATH_INFO: `/v3/projects/a2f67f417e4e4365bcec9e2b73521d04/users/be91dc160ef84675865d333d42c2bce5/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:57.980870 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86283046-289a-4409-897b-031165b27036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f67f417e4e4365bcec9e2b73521d04, user_id=be91dc160ef84675865d333d42c2bce5, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:57.984345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86283046-289a-4409-897b-031165b27036 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:58.005857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1350/2724] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:02:57 2022] PUT /identity/v3/projects/a2f67f417e4e4365bcec9e2b73521d04/users/be91dc160ef84675865d333d42c2bce5/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:02:58.011829 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edef6c-66ae-4dc4-b122-dc462c8ef8cc None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:58.012404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edef6c-66ae-4dc4-b122-dc462c8ef8cc None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:58.012961 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edef6c-66ae-4dc4-b122-dc462c8ef8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:58.038320 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d5edef6c-66ae-4dc4-b122-dc462c8ef8cc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:02:58.039775 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d5edef6c-66ae-4dc4-b122-dc462c8ef8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:58.146680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1375/2725] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:02:58.153303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283046-289a-4409-897b-031165b27036 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:02:58.155508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-86283046-289a-4409-897b-031165b27036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:02:58.257163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283046-289a-4409-897b-031165b27036 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:02:58.261684 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:02:58.262374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:02:58.262658 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:02:58.262933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:02:58.279732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:02:58.281435 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:02:58.293775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1351/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:03:03.892295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:03.893076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:03.894550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:03.943091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] MFA Rules not processed for user `be91dc160ef84675865d333d42c2bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:03.944920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:04.143002 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:04.158682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1376/2727] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:04.163111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:04.174397 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02762-aab5-401a-8b6a-6bd1d7d94d2d service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:04.179120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:04.179883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:04.180233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:04.180581 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:04.181337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:04.183369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:04.222708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1352/2728] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:03:04 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:03:04.227099 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:04.240510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80610b-49a7-4db9-b4f3-5c15083dd2f9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:04.409512 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:04.410254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:04.410544 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:04.411402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:04.411525 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:04.413464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:04.451490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1377/2729] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:03:04 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:03:04.455519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:04.469967 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fad57-6b8b-412b-88a7-f95c48461a20 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:04.484596 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:04.485775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:04.485775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:04.486067 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:04.486791 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:04.488548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:04.504502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1353/2730] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:03:04.505478 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:04.520855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3474-4d68-4d70-9287-d2ac953676d8 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:04.526504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:04.527606 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:04.527909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:04.528249 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] PATH_INFO: `/v3/projects/52315a2fc7d04f709db7c914b953022f/users/bcc3737a01ec4d018ce977ec7101a83a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:04.552401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52315a2fc7d04f709db7c914b953022f, user_id=bcc3737a01ec4d018ce977ec7101a83a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:04.556669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:04.582166 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1378/2731] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:03:04 2022] PUT /identity/v3/projects/52315a2fc7d04f709db7c914b953022f/users/bcc3737a01ec4d018ce977ec7101a83a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:03:04.586182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:04.609690 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05489f0-133f-4e1e-95fb-31ca2cc90422 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:04.760687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ede7-77be-4f0c-851a-f847723282bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:04.761646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ede7-77be-4f0c-851a-f847723282bc admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:04.762049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ede7-77be-4f0c-851a-f847723282bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:04.762423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ede7-77be-4f0c-851a-f847723282bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:04.763480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ede7-77be-4f0c-851a-f847723282bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:04.765328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ede7-77be-4f0c-851a-f847723282bc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:04.767257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:04.788434 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1354/2732] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:03:04.792182 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:04.802907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d398a-52ff-499e-b362-4fd97bf995cc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:04.820862 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c20a78-1923-4a7c-b5d8-6e872a65ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:04.821890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20a78-1923-4a7c-b5d8-6e872a65ea0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:04.822210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20a78-1923-4a7c-b5d8-6e872a65ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:04.822465 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20a78-1923-4a7c-b5d8-6e872a65ea0f admin admin] PATH_INFO: `/v3/projects/52315a2fc7d04f709db7c914b953022f/users/bcc3737a01ec4d018ce977ec7101a83a/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:04.829113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c20a78-1923-4a7c-b5d8-6e872a65ea0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52315a2fc7d04f709db7c914b953022f, user_id=bcc3737a01ec4d018ce977ec7101a83a, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:04.831960 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c20a78-1923-4a7c-b5d8-6e872a65ea0f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:04.858380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1379/2733] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:03:04 2022] PUT /identity/v3/projects/52315a2fc7d04f709db7c914b953022f/users/bcc3737a01ec4d018ce977ec7101a83a/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:03:08.832228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:08.833219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:08.833720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:08.875811 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] MFA Rules not processed for user `f5b8e8e45345409c835d5867166da134`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:08.877762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:08.995741 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1355/2734] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:12.377674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9491ff-4b5f-413b-b835-a5df1149cce8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:12.378281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9491ff-4b5f-413b-b835-a5df1149cce8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:12.378281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9491ff-4b5f-413b-b835-a5df1149cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:12.421242 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-6b9491ff-4b5f-413b-b835-a5df1149cce8 None None] MFA Rules not processed for user `bcc3737a01ec4d018ce977ec7101a83a`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:12.422852 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-6b9491ff-4b5f-413b-b835-a5df1149cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:12.515551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1380/2735] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:12.541651 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:12.543330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:12.661850 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c982b7-c029-48ac-9559-fee5a9f96f5c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:12.668146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211375edc5774281947e0b47714a1a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:12.669146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:12.669754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:12.670400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:12.763547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:12.765182 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:12.790900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1356/2736] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:03:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:03:12.946308 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ce5b-d8a1-4ccc-96c6-d9a5ca59fc69 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:12.946596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ce5b-d8a1-4ccc-96c6-d9a5ca59fc69 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:12.946897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ce5b-d8a1-4ccc-96c6-d9a5ca59fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:12.972070 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-ded3ce5b-d8a1-4ccc-96c6-d9a5ca59fc69 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:12.973761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ded3ce5b-d8a1-4ccc-96c6-d9a5ca59fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:13.025321 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:13.076005 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1381/2737] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:13.118433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:13.222523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:13.242119 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c478-6ae1-4b8c-a03c-c8b6e33f13e7 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:13.247854 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:13.248763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:13.249234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:13.249721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:13.274009 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:13.275979 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:13.286784 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1357/2738] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:03:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:23.063731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=10 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:23.282387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:24.194698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee05a9-20f8-41c6-b62c-3c9e6d8188c3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:24.194698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee05a9-20f8-41c6-b62c-3c9e6d8188c3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:24.194698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee05a9-20f8-41c6-b62c-3c9e6d8188c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:24.242830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4fee05a9-20f8-41c6-b62c-3c9e6d8188c3 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:24.250804 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4fee05a9-20f8-41c6-b62c-3c9e6d8188c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:24.294063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1382/2739] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 23 12:03:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:24.310935 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:24.330276 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c34c4-0b3c-4f34-b65c-0527afe237ec service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:24.337572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:24.338305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:24.339238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:24.339238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:24.348519 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:24.350163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:24.367943 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1358/2740] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:03:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:25.066432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc826-501b-496a-863d-50850c2e9302 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:25.066739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc826-501b-496a-863d-50850c2e9302 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:25.067032 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abc826-501b-496a-863d-50850c2e9302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:25.096481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-25abc826-501b-496a-863d-50850c2e9302 None None] MFA Rules not processed for user `be91dc160ef84675865d333d42c2bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:25.098264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-25abc826-501b-496a-863d-50850c2e9302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:25.106161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1383/2741] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:26.576197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:26.578324 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:26.649773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97c7b-1871-402c-ac7b-b205e2e9867f service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:26.655135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:26.656095 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:26.656609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:26.656904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] PATH_INFO: `/v3/users/f84f937a6bc644a7b67bbda82828eadd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:26.658827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84f937a6bc644a7b67bbda82828eadd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:26.660803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:26.713869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84f937a6bc644a7b67bbda82828eadd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:26.722193 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84f937a6bc644a7b67bbda82828eadd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:26.722932 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84f937a6bc644a7b67bbda82828eadd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:26.730143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84f937a6bc644a7b67bbda82828eadd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:26.730749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2d32254-b2b5-4edc-bc2f-8d7442c55cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84f937a6bc644a7b67bbda82828eadd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:26.750345 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1359/2742] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:03:26 2022] DELETE /identity/v3/users/f84f937a6bc644a7b67bbda82828eadd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:03:26.935309 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc826-501b-496a-863d-50850c2e9302 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:26.947919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abc826-501b-496a-863d-50850c2e9302 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.007597 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.008480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.008761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.009039 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] PATH_INFO: `/v3/projects/daf00712722c42a09f146c8725e73308` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.010354 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf00712722c42a09f146c8725e73308)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.012292 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.061709 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf00712722c42a09f146c8725e73308', 'request_id': 'req-e37c5d03-12ab-49cc-9991-40407ce55ef0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:27.070251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf00712722c42a09f146c8725e73308', 'request_id': 'req-e37c5d03-12ab-49cc-9991-40407ce55ef0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:27.076964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf00712722c42a09f146c8725e73308', 'request_id': 'req-e37c5d03-12ab-49cc-9991-40407ce55ef0'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:27.087560 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] The token cache is being invalidate because project daf00712722c42a09f146c8725e73308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:03:27.087854 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:27.088516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e37c5d03-12ab-49cc-9991-40407ce55ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:03:27.090151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1384/2743] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:03:26 2022] DELETE /identity/v3/projects/daf00712722c42a09f146c8725e73308 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:03:27.095680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.095982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.096260 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.115740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:27.117111 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:27.188138 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1360/2744] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:27.195861 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.196161 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.196480 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.219491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:27.220842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:27.231212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1385/2745] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:03:27.235740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.245868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd361e0-51b9-4766-9249-ac62531eb756 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.252087 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.252877 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.253060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.253311 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.254080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:03:27.254389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.256021 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.258014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:27.276331 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1361/2746] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:03:27.277397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.289653 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d70a2-06c1-461e-a9db-8ecb3feed747 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.295083 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.295788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.296074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.296362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.297976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.299974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.337792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1386/2747] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:03:27 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:03:27.341862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.352894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab1908-8212-4d7d-9955-7c1bf5645c4e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.428309 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f9587-5515-4da8-af0d-f4fa40ad7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.429170 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f9587-5515-4da8-af0d-f4fa40ad7c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.429459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f9587-5515-4da8-af0d-f4fa40ad7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.429812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f9587-5515-4da8-af0d-f4fa40ad7c5b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.430544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f9587-5515-4da8-af0d-f4fa40ad7c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.432547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f9587-5515-4da8-af0d-f4fa40ad7c5b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.457227 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1362/2748] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:03:27 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:03:27.461744 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.468775 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.469234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.469511 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.473558 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71929a3e-bb47-40a1-9db8-54192660457e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.478921 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.479874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.480410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.480890 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.482809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.484919 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.496962 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1387/2749] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:03:27.498255 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:27.500057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:27.500771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.511371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e28dc-199a-48e8-9f32-561f467a7af1 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.516372 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.517045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.517333 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.517649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.518461 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.520256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.531454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1388/2750] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:03:27.535683 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.546498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316a1d3-688c-42b9-a0e8-78b14c35c0e5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.551554 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9a372-31b0-481b-9230-7fc263833b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.552453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9a372-31b0-481b-9230-7fc263833b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.552797 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9a372-31b0-481b-9230-7fc263833b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.553024 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9a372-31b0-481b-9230-7fc263833b7b admin admin] PATH_INFO: `/v3/projects/0e4c27c608a54af0b4796105ab88a785/users/0f49a07d8fc94ea8a7dc54a2ec8654ce/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.570020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9a372-31b0-481b-9230-7fc263833b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4c27c608a54af0b4796105ab88a785, user_id=0f49a07d8fc94ea8a7dc54a2ec8654ce, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.570425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1363/2751] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Jun 23 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:03:27.573676 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9a372-31b0-481b-9230-7fc263833b7b admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.583529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.584986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:27.594981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1389/2752] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:03:27 2022] PUT /identity/v3/projects/0e4c27c608a54af0b4796105ab88a785/users/0f49a07d8fc94ea8a7dc54a2ec8654ce/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:03:27.602537 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.603115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.603587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.612817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:27.628627 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:27.629982 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:27.666868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4476-0adb-4e67-8118-5c292e7dbd1e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.706967 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1390/2753] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:03:27.710603 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:27.717195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:27.719116 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:27.746940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.747790 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.748164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.748649 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.785031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e21b68-5e40-4fdd-85be-229077439ee7 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:27.789564 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904232-06b0-4937-b17c-40033a716781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:27.790415 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904232-06b0-4937-b17c-40033a716781 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:27.790871 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904232-06b0-4937-b17c-40033a716781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:27.791319 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904232-06b0-4937-b17c-40033a716781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:27.802677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904232-06b0-4937-b17c-40033a716781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.804498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904232-06b0-4937-b17c-40033a716781 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.816077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1391/2754] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:03:27.828403 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:27.835249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:27.846027 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1364/2755] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 12:03:34.426141 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:34.426761 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:34.427424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:34.475142 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] MFA Rules not processed for user `0f49a07d8fc94ea8a7dc54a2ec8654ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:34.476470 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:34.605668 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1392/2756] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:34.607248 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:34.626592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85f59-8aec-4133-88e7-1b8337a3a7bf service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:34.648805 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:34.649341 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:34.649699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:34.650137 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:34.650916 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:34.653140 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:34.692208 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1365/2757] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:03:34 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:03:34.693315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:34.725052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d071d7-7e77-4a96-94ef-ee4d78b4b6c3 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:34.798184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:34.829964 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:34.830657 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:34.830948 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:34.831221 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:34.831939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:34.834023 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:34.861074 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1393/2758] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:03:34 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:03:34.862423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:34.874269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee3ba0-37d1-4d66-826b-eff6c76e395e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:34.880259 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:34.881264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:34.881548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:34.881872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:34.882645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:34.884261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:34.899582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1366/2759] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:03:34.903467 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:34.916233 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fb19-4bab-413f-9f8f-ef60638d4653 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:34.921534 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:34.922482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:34.922767 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:34.923046 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] PATH_INFO: `/v3/projects/da49600a4c514c1e94692c2695ee510b/users/4d65ca7c87f04fb480ff8eabc0d6e057/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:34.958445 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da49600a4c514c1e94692c2695ee510b, user_id=4d65ca7c87f04fb480ff8eabc0d6e057, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:34.964355 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:34.990472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1394/2760] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:03:34 2022] PUT /identity/v3/projects/da49600a4c514c1e94692c2695ee510b/users/4d65ca7c87f04fb480ff8eabc0d6e057/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:03:34.995028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:35.007503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee62e35-0a03-4a5b-b3c7-afdaee1c463d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:35.088365 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5f51-4957-4d3c-8514-564f3969a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:35.089049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5f51-4957-4d3c-8514-564f3969a529 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:35.089332 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5f51-4957-4d3c-8514-564f3969a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:35.089625 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5f51-4957-4d3c-8514-564f3969a529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:35.093080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5f51-4957-4d3c-8514-564f3969a529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:35.093080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5f51-4957-4d3c-8514-564f3969a529 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:35.108195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:35.112827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1367/2761] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:03:35.119402 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191c15-e436-4bc8-a0f0-40e1bd63beeb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:35.126001 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:35.126942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:35.127219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:35.127492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] PATH_INFO: `/v3/projects/da49600a4c514c1e94692c2695ee510b/users/4d65ca7c87f04fb480ff8eabc0d6e057/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:35.131055 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da49600a4c514c1e94692c2695ee510b, user_id=4d65ca7c87f04fb480ff8eabc0d6e057, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:35.133715 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:35.148781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1395/2762] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:03:35 2022] PUT /identity/v3/projects/da49600a4c514c1e94692c2695ee510b/users/4d65ca7c87f04fb480ff8eabc0d6e057/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:03:40.499969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9712be-ff77-4128-b230-3a8a8fab4349 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:40.500726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9712be-ff77-4128-b230-3a8a8fab4349 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:40.500726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9712be-ff77-4128-b230-3a8a8fab4349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:40.531097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7a9712be-ff77-4128-b230-3a8a8fab4349 None None] MFA Rules not processed for user `4d65ca7c87f04fb480ff8eabc0d6e057`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:40.532372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a9712be-ff77-4128-b230-3a8a8fab4349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:40.572742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:40.658663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1368/2763] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:40.672860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:40.677634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:40.775312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369c895-a6fe-42de-81bf-cd2816f66143 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:40.782414 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:40.783098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:40.783378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:40.783661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:40.862787 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:40.864530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:40.875219 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1396/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:03:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:03:41.991624 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:41.992147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:41.992245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:42.010825 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] MFA Rules not processed for user `0f49a07d8fc94ea8a7dc54a2ec8654ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:03:42.012187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:42.019333 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1369/2765] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:03:48.221410 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:03:48.257776 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:48.294057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51e9f-49a2-401f-928f-80e5871dbe62 service nova] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:03:48.298976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:03:48.299631 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:03:48.300311 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:03:48.300594 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:03:48.302793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:03:48.378879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:03:48.380365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4435f-1563-4e33-931a-c1e1f837f004 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:03:48.391697 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1397/2766] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:03:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:03:52.005076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=21 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:58.386115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=39 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:07.993156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:04:08.003939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8d9c-18dd-491a-bcef-669d4bfaa638 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:04:08.008534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:04:08.009197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:04:08.009486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:04:08.009810 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:04:08.021588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:04:08.023093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:04:08.034048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1370/2767] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:04:12.537817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43264-0116-443f-9639-b019dcc9719b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:04:12.538371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43264-0116-443f-9639-b019dcc9719b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:04:12.538371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e43264-0116-443f-9639-b019dcc9719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:04:12.556071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-a6e43264-0116-443f-9639-b019dcc9719b None None] MFA Rules not processed for user `f5b8e8e45345409c835d5867166da134`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:04:12.557280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a6e43264-0116-443f-9639-b019dcc9719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:04:12.615212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1398/2768] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:04:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:04:18.028729 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:22.607990 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=25 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:27.666509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:04:27.668055 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:04:27.743991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d01f-eb38-449e-bf72-57aa63cf13f5 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:04:27.748930 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:04:27.749667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:04:27.749970 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:04:27.750243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:04:27.752663 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:04:27.764546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:04:27.766200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:04:27.776884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1371/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:04:37.772090 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=32 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:16.318721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:16.319369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:16.319369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:16.341027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] MFA Rules not processed for user `60818dbaf4ec4ec998f93a603bafa773`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:16.342406 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:16.407205 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1399/2770] 10.222.0.27 () {58 vars in 967 bytes} [Thu Jun 23 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:16.455343 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:16.530896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a196b5-a70a-47e3-a103-799624f7fa54 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:16.536204 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cc01f5555e4fdea9b883ab08c31acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:16.536938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:16.537225 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:16.537590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:16.546347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:16.548191 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:16.556369 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1372/2771] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Jun 23 12:05:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:05:16.898825 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:16.901423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:16.923930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1ef76-91e4-453d-8f05-8bdaca47cf46 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:16.932288 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:16.933231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:16.933643 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:16.934027 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:16.935970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:16.949584 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:16.951601 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:16.973063 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1400/2772] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:05:16.979010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:16.982767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:17.082440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25e49-27b2-4446-b1c9-31f39d2d3d9b service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.087269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.088175 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.088464 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.088747 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] PATH_INFO: `/v3/users/f5b8e8e45345409c835d5867166da134` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.090163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b8e8e45345409c835d5867166da134)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.092127 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.154187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b8e8e45345409c835d5867166da134'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.165687 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b8e8e45345409c835d5867166da134'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.166419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b8e8e45345409c835d5867166da134'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.174756 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b8e8e45345409c835d5867166da134'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.175541 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6447dca4-d572-4966-868c-858adc370002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b8e8e45345409c835d5867166da134'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.193875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1373/2773] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:16 2022] DELETE /identity/v3/users/f5b8e8e45345409c835d5867166da134 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:17.391746 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.406796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12f3b6-bd37-42ff-90d9-f2fb1adf70c8 service placement] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.475222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.476091 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.476376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.476656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] PATH_INFO: `/v3/projects/5b3300475d7b4add905684b9e7772949` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.477868 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3300475d7b4add905684b9e7772949)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.479809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.531485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3300475d7b4add905684b9e7772949', 'request_id': 'req-3d22ce70-8d06-4bda-9b5b-2d26305719ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.540392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3300475d7b4add905684b9e7772949', 'request_id': 'req-3d22ce70-8d06-4bda-9b5b-2d26305719ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.547171 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3300475d7b4add905684b9e7772949', 'request_id': 'req-3d22ce70-8d06-4bda-9b5b-2d26305719ea'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.558190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] The token cache is being invalidate because project 5b3300475d7b4add905684b9e7772949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:17.558490 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.559158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-3d22ce70-8d06-4bda-9b5b-2d26305719ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:17.560993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1401/2774] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:17 2022] DELETE /identity/v3/projects/5b3300475d7b4add905684b9e7772949 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:17.566014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.566539 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.566682 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.586813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:17.588152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:17.593072 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:17.653440 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1374/2775] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:17.661842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.662064 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.662353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.681769 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:17.682981 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:17.695986 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1402/2776] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:05:17.697712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.708057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd25e5-a9db-4e69-9011-0dca17d59dbc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.712680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.713335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.713885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.714017 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.714643 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:05:17.714953 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.716554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.732593 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1375/2777] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:05:17.734020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.744208 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c281-3190-49c0-8325-d504db822f31 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.749178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.749976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.750347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.750842 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.751565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.753507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.767029 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:17.781542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1403/2778] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:05:17 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:17.786512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.797076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf0db-5e3e-45c8-bcee-0b1224facad0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.856210 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.857282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.857569 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.857878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.858639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.860698 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.889676 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1376/2779] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:05:17 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:17.891902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.903456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d7ae6-b319-4e4f-92c4-93f333d6ce98 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.910698 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.911430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.911711 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.912037 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.912728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.914428 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.927670 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1404/2780] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:05:17.931826 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.945350 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f8c2-5f73-455c-b57c-ed36c57b4577 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.950609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0e74-cdf5-4ad5-bf76-795ade8c1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.951304 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0e74-cdf5-4ad5-bf76-795ade8c1a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.951592 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0e74-cdf5-4ad5-bf76-795ade8c1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.951871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0e74-cdf5-4ad5-bf76-795ade8c1a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:17.952621 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0e74-cdf5-4ad5-bf76-795ade8c1a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:17.954445 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0e74-cdf5-4ad5-bf76-795ade8c1a0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:17.966323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1377/2781] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:05:17.970556 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:17.982732 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444b547-43e0-4d76-964c-bf60edeccd8d admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:17.987645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:17.988909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:17.988909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:17.989202 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] PATH_INFO: `/v3/projects/e6093feb482c4fcb8fea800aa845cadf/users/c0b888f16e5a40a68d03e6e7c7e377e4/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.007277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6093feb482c4fcb8fea800aa845cadf, user_id=c0b888f16e5a40a68d03e6e7c7e377e4, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.010378 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.026451 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1405/2782] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:05:17 2022] PUT /identity/v3/projects/e6093feb482c4fcb8fea800aa845cadf/users/c0b888f16e5a40a68d03e6e7c7e377e4/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:05:18.038230 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.038523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.038808 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.069627 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] MFA Rules not processed for user `c0b888f16e5a40a68d03e6e7c7e377e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:18.071042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:18.138014 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1378/2783] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:18.143151 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.210092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9a62b-840b-40f9-bfcf-b31e21e1e2bc admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.214971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.215645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.215940 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.216215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.216929 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.218918 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.245500 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1406/2784] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:05:18 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:18.249867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.256712 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:18.261859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbcf1-8fc7-42b9-b5ae-18c02c86fa51 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.323689 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.324546 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.324846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.325126 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.325894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.327879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.354419 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1379/2785] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:05:18 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:05:18.355800 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.368899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035e42f-1455-4fdc-8722-f0c77c85ed90 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.377509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.378228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.378516 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.378792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.379619 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.381291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.393174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1407/2786] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:05:18.397355 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.409869 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5bf3b-2760-4aee-a3c3-362460827d0e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.416939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.418662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.419813 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.421008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] PATH_INFO: `/v3/projects/bba22582ad2145a9b364a52954f644b9/users/73b173fc5a454fdbb2ca7d2b2cf38580/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.443786 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba22582ad2145a9b364a52954f644b9, user_id=73b173fc5a454fdbb2ca7d2b2cf38580, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.446620 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.464688 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1380/2787] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:05:18 2022] PUT /identity/v3/projects/bba22582ad2145a9b364a52954f644b9/users/73b173fc5a454fdbb2ca7d2b2cf38580/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:18.465909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.477993 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feffcf6-0e8e-43f0-bae6-d2e949efafa2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.545360 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ced7-5608-4a29-bf24-635b6786c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.546146 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ced7-5608-4a29-bf24-635b6786c008 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.546509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ced7-5608-4a29-bf24-635b6786c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.546882 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ced7-5608-4a29-bf24-635b6786c008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.547779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ced7-5608-4a29-bf24-635b6786c008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.549468 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ced7-5608-4a29-bf24-635b6786c008 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.560167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1408/2788] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:05:18.564927 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.575896 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657b4f-4461-4cfc-b081-9867b95c7c06 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.583226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.585200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.585731 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.586177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] PATH_INFO: `/v3/projects/bba22582ad2145a9b364a52954f644b9/users/73b173fc5a454fdbb2ca7d2b2cf38580/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.589769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba22582ad2145a9b364a52954f644b9, user_id=73b173fc5a454fdbb2ca7d2b2cf38580, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.592630 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.612521 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1381/2789] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:05:18 2022] PUT /identity/v3/projects/bba22582ad2145a9b364a52954f644b9/users/73b173fc5a454fdbb2ca7d2b2cf38580/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:18.631047 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.631510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.632616 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.671630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] MFA Rules not processed for user `73b173fc5a454fdbb2ca7d2b2cf38580`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:18.673442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:18.698693 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:18.763530 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1409/2790] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:18.776158 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.777767 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:18.837453 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b478c-0b6b-4624-a935-d4a04bcb9c87 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.841390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.842361 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.842748 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.843162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:18.854096 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:18.855845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:18.873733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1382/2791] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:05:18.958582 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:18.969228 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0404-4978-42a9-8486-52486a605f92 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:18.973093 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:18.973865 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:18.974347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:18.974720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:19.034588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:19.036169 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:19.046706 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1410/2792] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:05:23.708213 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:23.709972 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:23.783699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acbfbb-07d1-4417-96a3-aff882a879ca service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:23.788251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:23.789129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:23.789414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:23.789726 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] PATH_INFO: `/v3/users/be91dc160ef84675865d333d42c2bce5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:23.790921 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be91dc160ef84675865d333d42c2bce5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:23.792841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:23.794428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:23.843654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be91dc160ef84675865d333d42c2bce5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:23.850529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be91dc160ef84675865d333d42c2bce5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:23.851212 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be91dc160ef84675865d333d42c2bce5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:23.861408 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be91dc160ef84675865d333d42c2bce5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:23.862190 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be91dc160ef84675865d333d42c2bce5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:23.881544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1383/2793] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:23 2022] DELETE /identity/v3/users/be91dc160ef84675865d333d42c2bce5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:24.068307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:24.080132 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b4d0a-aa9b-44b9-938d-cfbefa1e76a9 service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:24.148959 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:24.149877 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:24.150159 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:24.150429 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] PATH_INFO: `/v3/projects/a2f67f417e4e4365bcec9e2b73521d04` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:24.151745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f67f417e4e4365bcec9e2b73521d04)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:24.153694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:24.208388 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f67f417e4e4365bcec9e2b73521d04', 'request_id': 'req-0e6ca5ed-464f-44f0-af03-02a25195d62a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.211956 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:24.219743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f67f417e4e4365bcec9e2b73521d04', 'request_id': 'req-0e6ca5ed-464f-44f0-af03-02a25195d62a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.229422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f67f417e4e4365bcec9e2b73521d04', 'request_id': 'req-0e6ca5ed-464f-44f0-af03-02a25195d62a'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.241872 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] The token cache is being invalidate because project a2f67f417e4e4365bcec9e2b73521d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:24.242201 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.242973 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.244887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1411/2794] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:24 2022] DELETE /identity/v3/projects/a2f67f417e4e4365bcec9e2b73521d04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:24.249348 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:24.251387 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:24.265329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4a358-a093-4779-ad42-afa9bcbdc070 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:24.328328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:24.329250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:24.329532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:24.329841 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] PATH_INFO: `/v3/users/bcc3737a01ec4d018ce977ec7101a83a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:24.331120 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc3737a01ec4d018ce977ec7101a83a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:24.333060 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:24.382601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc3737a01ec4d018ce977ec7101a83a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.389186 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc3737a01ec4d018ce977ec7101a83a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.389861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc3737a01ec4d018ce977ec7101a83a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.398957 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc3737a01ec4d018ce977ec7101a83a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.399566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc3737a01ec4d018ce977ec7101a83a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.412904 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:24.419024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1384/2795] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:24 2022] DELETE /identity/v3/users/bcc3737a01ec4d018ce977ec7101a83a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:24.626708 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:24.629251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:24.644243 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ca5ed-464f-44f0-af03-02a25195d62a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:24.720721 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:24.721781 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:24.722200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:24.722550 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] PATH_INFO: `/v3/projects/52315a2fc7d04f709db7c914b953022f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:24.723996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52315a2fc7d04f709db7c914b953022f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:24.726773 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:24.778815 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52315a2fc7d04f709db7c914b953022f', 'request_id': 'req-952a0a79-114a-4c4c-981a-a2fd7b19a902'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.787312 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52315a2fc7d04f709db7c914b953022f', 'request_id': 'req-952a0a79-114a-4c4c-981a-a2fd7b19a902'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.794459 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52315a2fc7d04f709db7c914b953022f', 'request_id': 'req-952a0a79-114a-4c4c-981a-a2fd7b19a902'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.806115 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] The token cache is being invalidate because project 52315a2fc7d04f709db7c914b953022f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:24.806535 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.807245 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-952a0a79-114a-4c4c-981a-a2fd7b19a902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:24.809128 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1412/2796] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:24 2022] DELETE /identity/v3/projects/52315a2fc7d04f709db7c914b953022f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:34.424347 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:34.802942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:48.796563 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:48.798203 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:48.811890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253284-3f23-4b8e-bf64-a167cad4282f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:48.874372 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:48.875667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:48.875994 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:48.876364 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] PATH_INFO: `/v3/users/c0b888f16e5a40a68d03e6e7c7e377e4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:48.878454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b888f16e5a40a68d03e6e7c7e377e4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:48.881534 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:48.936671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b888f16e5a40a68d03e6e7c7e377e4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:48.943782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b888f16e5a40a68d03e6e7c7e377e4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:48.944473 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b888f16e5a40a68d03e6e7c7e377e4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:48.953340 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b888f16e5a40a68d03e6e7c7e377e4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:48.954065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b888f16e5a40a68d03e6e7c7e377e4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:48.972762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1385/2797] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:48 2022] DELETE /identity/v3/users/c0b888f16e5a40a68d03e6e7c7e377e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:48.977382 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:48.977917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:48.978035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:48.998004 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:48.999224 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:49.062307 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1413/2798] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:49.072740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:49.074840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:49.137720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f90cc9-d649-4fdc-9175-77d0cdabb83d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:49.141629 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:49.142303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:49.142590 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:49.142867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:49.152417 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:49.154020 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:49.163617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1386/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:05:49.436222 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:49.437759 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:49.450896 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa67a-cf51-4b4b-bf20-0c3532f4f03b None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:49.457362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:49.458304 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:49.458590 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:49.458941 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] PATH_INFO: `/v3/projects/e6093feb482c4fcb8fea800aa845cadf` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:49.460052 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6093feb482c4fcb8fea800aa845cadf)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:49.462000 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:49.513650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6093feb482c4fcb8fea800aa845cadf', 'request_id': 'req-962ebd53-2c11-4f89-a4a5-f413e85584cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.522241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6093feb482c4fcb8fea800aa845cadf', 'request_id': 'req-962ebd53-2c11-4f89-a4a5-f413e85584cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.528984 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6093feb482c4fcb8fea800aa845cadf', 'request_id': 'req-962ebd53-2c11-4f89-a4a5-f413e85584cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.539281 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] The token cache is being invalidate because project e6093feb482c4fcb8fea800aa845cadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:49.539571 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.540187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.541780 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1414/2800] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:49 2022] DELETE /identity/v3/projects/e6093feb482c4fcb8fea800aa845cadf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:05:49.545982 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:49.556136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d286c0-6d3f-4003-8a42-a4faf435777e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:49.578048 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:49.619267 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:49.620242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:49.620588 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:49.620974 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] PATH_INFO: `/v3/users/73b173fc5a454fdbb2ca7d2b2cf38580` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:49.622251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b173fc5a454fdbb2ca7d2b2cf38580)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:49.624195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:49.686139 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b173fc5a454fdbb2ca7d2b2cf38580'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.693209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b173fc5a454fdbb2ca7d2b2cf38580'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.693948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b173fc5a454fdbb2ca7d2b2cf38580'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.703776 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b173fc5a454fdbb2ca7d2b2cf38580'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.704402 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-986d0157-19c0-4a85-b0b8-483895918473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b173fc5a454fdbb2ca7d2b2cf38580'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:49.722425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1387/2801] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:49 2022] DELETE /identity/v3/users/73b173fc5a454fdbb2ca7d2b2cf38580 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:50.019154 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.020920 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:50.034707 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ebd53-2c11-4f89-a4a5-f413e85584cb admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.093791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.094713 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.094970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.095271 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] PATH_INFO: `/v3/projects/bba22582ad2145a9b364a52954f644b9` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.096630 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba22582ad2145a9b364a52954f644b9)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.098635 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.131230 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:50.153745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba22582ad2145a9b364a52954f644b9', 'request_id': 'req-0b60e93e-5a4c-43ea-b36d-52254551ab22'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:50.165342 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba22582ad2145a9b364a52954f644b9', 'request_id': 'req-0b60e93e-5a4c-43ea-b36d-52254551ab22'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:50.171831 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba22582ad2145a9b364a52954f644b9', 'request_id': 'req-0b60e93e-5a4c-43ea-b36d-52254551ab22'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:50.182190 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] The token cache is being invalidate because project bba22582ad2145a9b364a52954f644b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:50.182485 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:50.183156 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-0b60e93e-5a4c-43ea-b36d-52254551ab22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:50.184771 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1415/2802] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:50 2022] DELETE /identity/v3/projects/bba22582ad2145a9b364a52954f644b9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:50.190073 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.190566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.190566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.210322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:50.211847 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:50.281200 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1388/2803] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:50.289203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.289498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.289820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.309906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:50.311126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:50.319910 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1416/2804] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:50.324128 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.334673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e4100-b781-4172-8001-698eda7d8448 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.339846 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.340524 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.340807 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.341105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.341860 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:05:50.342168 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.343771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.355909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1389/2805] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:05:50.360545 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.370652 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd117e-da85-4166-ac43-2d8711a4b678 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.377031 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.377729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.378016 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.378297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.378994 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.380915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.410061 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1417/2806] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:50.414298 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.425449 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c43b94-0e4c-4aae-8cab-580e417303d0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.453249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:50.486946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.487631 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.487915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.488198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.488893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.490909 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.514353 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1390/2807] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:50.518798 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.529398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8c87e-01c2-4f59-8148-9f910522ac4a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.534442 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.535105 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.535391 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.535671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.536426 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.538059 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.549051 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1418/2808] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:05:50.553108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.564129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f678b-1969-4d47-a640-f423c38e5804 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.569261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec544d-cedd-4676-8b98-f80f83f640a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.569971 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec544d-cedd-4676-8b98-f80f83f640a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.570253 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec544d-cedd-4676-8b98-f80f83f640a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.570543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec544d-cedd-4676-8b98-f80f83f640a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.571257 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec544d-cedd-4676-8b98-f80f83f640a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.572883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec544d-cedd-4676-8b98-f80f83f640a1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.583885 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1391/2809] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:05:50.588057 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.598364 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818362c3-1c0e-42b6-b301-7982711471d0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.603111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.604038 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.604325 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.604604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] PATH_INFO: `/v3/projects/3d756ca62d774be48447b2981a9a1f3b/users/41b6bdde08704c55880c528c377106f6/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.620557 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d756ca62d774be48447b2981a9a1f3b, user_id=41b6bdde08704c55880c528c377106f6, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.623401 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.639131 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1419/2810] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:05:50 2022] PUT /identity/v3/projects/3d756ca62d774be48447b2981a9a1f3b/users/41b6bdde08704c55880c528c377106f6/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:50.649667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.649958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.650235 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.676721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] MFA Rules not processed for user `41b6bdde08704c55880c528c377106f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:50.677965 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:50.742516 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1392/2811] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:50.747183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.815942 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c883b8d-3dd6-4fb9-91d8-8d442e24d36e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.821117 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.821822 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.822108 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.822387 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.823082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.825044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.853177 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1420/2812] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:50.858145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.869915 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131e0d-9e88-4cef-b498-f135e0be7b20 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.927797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.928468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.928754 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.929029 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.929763 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.931706 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.955762 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1393/2813] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:05:50 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:05:50.959813 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:50.970588 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8387740-4e16-4404-b8fe-d679c9ec42af admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:50.975549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:50.976215 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:50.976507 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:50.976784 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:50.977555 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:50.979200 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:50.991019 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1421/2814] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:05:50.995219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:51.010845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27e4fb-2ab9-4f64-a7c2-4f2eb6096204 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:51.017969 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:51.018884 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:51.019163 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:51.019438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] PATH_INFO: `/v3/projects/57111ae3c8b84628a65590506444a78e/users/b6f8b5fcd7b447f8b0c9483b9a5794b1/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:51.036749 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57111ae3c8b84628a65590506444a78e, user_id=b6f8b5fcd7b447f8b0c9483b9a5794b1, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:51.039525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:51.055249 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1394/2815] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:05:50 2022] PUT /identity/v3/projects/57111ae3c8b84628a65590506444a78e/users/b6f8b5fcd7b447f8b0c9483b9a5794b1/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:51.059258 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:51.069754 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c95b8-51fb-4cd3-98a0-4ad8ae620c32 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:51.090522 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:51.132856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc510ef3-1f14-48e6-9678-705c7c276135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:51.133529 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510ef3-1f14-48e6-9678-705c7c276135 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:51.133843 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510ef3-1f14-48e6-9678-705c7c276135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:51.134124 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510ef3-1f14-48e6-9678-705c7c276135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:51.134864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc510ef3-1f14-48e6-9678-705c7c276135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:51.136483 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc510ef3-1f14-48e6-9678-705c7c276135 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:51.146247 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1422/2816] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:05:51.151243 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:51.160258 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:51.169176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169a72-41f5-4a90-aa65-ee7c84e9ff51 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:51.174963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:51.175859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:51.176141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:51.176416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] PATH_INFO: `/v3/projects/57111ae3c8b84628a65590506444a78e/users/b6f8b5fcd7b447f8b0c9483b9a5794b1/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:51.178721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57111ae3c8b84628a65590506444a78e, user_id=b6f8b5fcd7b447f8b0c9483b9a5794b1, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:51.181393 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:51.192428 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1395/2817] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:05:51 2022] PUT /identity/v3/projects/57111ae3c8b84628a65590506444a78e/users/b6f8b5fcd7b447f8b0c9483b9a5794b1/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:51.207497 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:51.207811 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:51.208092 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:51.244098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] MFA Rules not processed for user `b6f8b5fcd7b447f8b0c9483b9a5794b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:51.245385 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:51.321025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1423/2818] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:51.332700 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:51.334827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:51.400123 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796513b-dec2-4308-91b7-e450c109be54 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:51.405164 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:51.405820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:51.406129 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:51.406404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:51.416604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:51.418117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:51.428360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1396/2819] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:05:51.505234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:51.515398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45718140-31f6-4d25-9ec5-b84f9d3f2447 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:51.519003 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a02859-b350-440c-86a3-ba7d41ab5ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:51.519669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02859-b350-440c-86a3-ba7d41ab5ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:51.519972 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02859-b350-440c-86a3-ba7d41ab5ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:51.520231 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a02859-b350-440c-86a3-ba7d41ab5ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:51.580785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a02859-b350-440c-86a3-ba7d41ab5ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:51.582295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a02859-b350-440c-86a3-ba7d41ab5ef0 service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:51.593424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1424/2820] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:05:58.486673 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:58.551939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e2aef-1e57-4abf-bc95-d85f7e37eb11 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:58.556991 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:58.557919 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:58.558195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:58.558468 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] PATH_INFO: `/v3/users/41b6bdde08704c55880c528c377106f6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:58.559697 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b6bdde08704c55880c528c377106f6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:58.561652 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:58.614177 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b6bdde08704c55880c528c377106f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:58.624757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b6bdde08704c55880c528c377106f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:58.625727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b6bdde08704c55880c528c377106f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:58.636568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b6bdde08704c55880c528c377106f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:58.637327 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b6bdde08704c55880c528c377106f6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:58.657278 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1397/2821] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:58 2022] DELETE /identity/v3/users/41b6bdde08704c55880c528c377106f6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:58.662184 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:58.662694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:58.662694 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:58.680178 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:58.681369 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:58.721886 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=100 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:58.742917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1425/2822] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:05:58.753056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:58.754933 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:58.770765 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:58.820833 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bc5ad-69e7-404d-92b7-ff4bcb9da294 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:58.824777 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:58.825441 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:58.825759 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:58.826036 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:58.835900 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:58.837338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:58.847081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1398/2823] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:05:59.131743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:59.133283 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:59.149206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940dbfe-f55d-4ee5-bbf3-8aab0bba5c75 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:59.155844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:59.156632 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:59.156864 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:59.157120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] PATH_INFO: `/v3/projects/3d756ca62d774be48447b2981a9a1f3b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:59.158351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d756ca62d774be48447b2981a9a1f3b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:59.160614 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:59.222358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d756ca62d774be48447b2981a9a1f3b', 'request_id': 'req-bb49ea13-4804-47f1-9acc-fc431581571f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.231765 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d756ca62d774be48447b2981a9a1f3b', 'request_id': 'req-bb49ea13-4804-47f1-9acc-fc431581571f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.238472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d756ca62d774be48447b2981a9a1f3b', 'request_id': 'req-bb49ea13-4804-47f1-9acc-fc431581571f'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.249945 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] The token cache is being invalidate because project 3d756ca62d774be48447b2981a9a1f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:59.250238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.251011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.252681 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1426/2824] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:59 2022] DELETE /identity/v3/projects/3d756ca62d774be48447b2981a9a1f3b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:59.256984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:59.266555 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa933b3-dfb5-483e-aebc-a22b7fa92b8c service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:59.326662 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:59.327556 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:59.327844 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:59.328122 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] PATH_INFO: `/v3/users/b6f8b5fcd7b447f8b0c9483b9a5794b1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:59.329312 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f8b5fcd7b447f8b0c9483b9a5794b1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:59.331316 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:59.379861 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f8b5fcd7b447f8b0c9483b9a5794b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.387010 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f8b5fcd7b447f8b0c9483b9a5794b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.387667 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f8b5fcd7b447f8b0c9483b9a5794b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.397386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f8b5fcd7b447f8b0c9483b9a5794b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.398156 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d32d0528-fb17-4bb1-a420-4d898d32d18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f8b5fcd7b447f8b0c9483b9a5794b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.416836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1399/2825] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:05:59 2022] DELETE /identity/v3/users/b6f8b5fcd7b447f8b0c9483b9a5794b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:59.733649 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:05:59.736144 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:59.751238 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ea13-4804-47f1-9acc-fc431581571f admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:05:59.812318 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:05:59.813188 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:59.813475 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:59.813757 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] PATH_INFO: `/v3/projects/57111ae3c8b84628a65590506444a78e` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:59.814979 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57111ae3c8b84628a65590506444a78e)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:05:59.817008 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:05:59.874695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57111ae3c8b84628a65590506444a78e', 'request_id': 'req-1ea70799-e902-4225-a1b9-6c147672f1e5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.885015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57111ae3c8b84628a65590506444a78e', 'request_id': 'req-1ea70799-e902-4225-a1b9-6c147672f1e5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.891785 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57111ae3c8b84628a65590506444a78e', 'request_id': 'req-1ea70799-e902-4225-a1b9-6c147672f1e5'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.898189 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:59.903025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] The token cache is being invalidate because project 57111ae3c8b84628a65590506444a78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:05:59.903640 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.904458 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-1ea70799-e902-4225-a1b9-6c147672f1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:05:59.906160 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1427/2826] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:05:59 2022] DELETE /identity/v3/projects/57111ae3c8b84628a65590506444a78e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:05:59.911508 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:05:59.912028 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:05:59.912143 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:05:59.931254 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:05:59.932484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:05:59.962300 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:59.995420 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1400/2827] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:00.003897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.004197 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.004509 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.023453 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:00.024644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:00.032980 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1428/2828] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:00.038061 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.053828 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea97fa-70b5-4a9b-8e02-3753738faa64 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.062594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.063544 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.063938 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.064269 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.065356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:06:00.066121 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.067757 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.079459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1401/2829] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:06:00.083985 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.093440 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaae5ed-40c0-4be9-8bbe-e3e20437d492 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.098883 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.099543 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.099837 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.100113 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.100830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.102788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.132731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1429/2830] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:00.137023 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.147489 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed10137-4dbb-4c0e-b00d-7d4419a330eb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.207307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.207993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.208282 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.208564 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.209261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.211263 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.235262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1402/2831] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:00.240079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.256729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945890-d381-4b5b-a3cc-5e9c2537ded5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.265833 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.266542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.266897 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.267264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.268374 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.270471 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.281460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1430/2832] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:00.286141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.296737 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947b88f-53b9-499f-b55c-0ba1681c0e9f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.302499 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1e516-f257-495d-a07d-3dee74460e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.303161 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e516-f257-495d-a07d-3dee74460e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.303446 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e516-f257-495d-a07d-3dee74460e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.303720 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e516-f257-495d-a07d-3dee74460e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.304459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1e516-f257-495d-a07d-3dee74460e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.306112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1e516-f257-495d-a07d-3dee74460e49 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.316610 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1403/2833] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:00.320660 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.330911 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3392c-00f3-4c5c-9083-da8c4752fe03 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.337179 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.338119 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.338397 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.338673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] PATH_INFO: `/v3/projects/eb610d4085e44e789a8db5ed2b399621/users/9f8e5697fa6741a2bbaac62dd0175a50/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.354730 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb610d4085e44e789a8db5ed2b399621, user_id=9f8e5697fa6741a2bbaac62dd0175a50, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.359172 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.375626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1431/2834] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:00 2022] PUT /identity/v3/projects/eb610d4085e44e789a8db5ed2b399621/users/9f8e5697fa6741a2bbaac62dd0175a50/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:06:00.386065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.386359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.386639 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.413421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] MFA Rules not processed for user `9f8e5697fa6741a2bbaac62dd0175a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:00.414594 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:00.480247 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1404/2835] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:00.485280 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.554025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0b88-a241-4cb2-91fd-49348e8808e2 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.559457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.560086 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.560425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.560675 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.561398 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.563346 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.591930 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1432/2836] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:00.596056 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.608109 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45c24e-ffcb-45e5-be99-1055ae043352 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.635275 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:00.668876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.669497 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.677238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.677238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.677238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.677238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.700135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1405/2837] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:00.704365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.715103 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84805bed-d8d8-4376-bdb4-7e5fb67e33bf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.720294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.720974 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.721264 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.721542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.722856 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.724486 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.735971 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1433/2838] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:00.741727 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.752305 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fd022-7cfe-42a1-b6aa-8b72dc33fa49 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.758946 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.759859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.760145 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.760424 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] PATH_INFO: `/v3/projects/e1385dd4b91c4f4f882b8759cce3dc5f/users/d78396450492483d88a54be7dba31a22/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.777329 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1385dd4b91c4f4f882b8759cce3dc5f, user_id=d78396450492483d88a54be7dba31a22, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.780058 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.795617 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1406/2839] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:00 2022] PUT /identity/v3/projects/e1385dd4b91c4f4f882b8759cce3dc5f/users/d78396450492483d88a54be7dba31a22/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:00.799691 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.810340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007890f-6fc3-4e22-9959-18d6852756f0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.868826 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff5d5-5ca6-45d5-b7f5-13e949db7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.869491 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff5d5-5ca6-45d5-b7f5-13e949db7e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.869792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff5d5-5ca6-45d5-b7f5-13e949db7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.870068 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff5d5-5ca6-45d5-b7f5-13e949db7e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.870814 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff5d5-5ca6-45d5-b7f5-13e949db7e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.872422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff5d5-5ca6-45d5-b7f5-13e949db7e2c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.882279 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1434/2840] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:06:00.887209 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:00.902952 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f2ec-0816-4c7d-afe2-b9db40c2bfc3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:00.910442 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:00.911323 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.911601 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.912187 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] PATH_INFO: `/v3/projects/e1385dd4b91c4f4f882b8759cce3dc5f/users/d78396450492483d88a54be7dba31a22/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.913872 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1385dd4b91c4f4f882b8759cce3dc5f, user_id=d78396450492483d88a54be7dba31a22, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:00.916503 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:00.927338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1407/2841] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:00 2022] PUT /identity/v3/projects/e1385dd4b91c4f4f882b8759cce3dc5f/users/d78396450492483d88a54be7dba31a22/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:00.938809 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:00.939097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:00.939371 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:00.947136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:00.969133 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] MFA Rules not processed for user `d78396450492483d88a54be7dba31a22`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:00.970413 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:01.042532 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1435/2842] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:01.054423 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:01.056455 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:01.116898 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bda3a8-886a-4aed-8c76-a5609e5cdd67 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:01.121486 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:01.122169 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:01.122450 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:01.122721 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:01.182400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:01.183914 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:01.198788 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1408/2843] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:03.803700 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:03.818869 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3345-c0b2-427f-b838-36a897d89f7a None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:03.823421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad798e-9d54-4c13-8672-245c65d2f08f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:03.824077 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad798e-9d54-4c13-8672-245c65d2f08f service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:03.824365 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad798e-9d54-4c13-8672-245c65d2f08f service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:03.824674 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad798e-9d54-4c13-8672-245c65d2f08f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:03.835185 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad798e-9d54-4c13-8672-245c65d2f08f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:03.836642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad798e-9d54-4c13-8672-245c65d2f08f service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:03.846752 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1436/2844] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:11.194538 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:13.842255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=38 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:16.550219 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:16.618233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef582-6e97-40a2-9971-765017367d5d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:16.623530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:16.624414 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:16.624703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:16.624955 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] PATH_INFO: `/v3/users/9f8e5697fa6741a2bbaac62dd0175a50` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:16.626195 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8e5697fa6741a2bbaac62dd0175a50)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:16.628142 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:16.680099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8e5697fa6741a2bbaac62dd0175a50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:16.688320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8e5697fa6741a2bbaac62dd0175a50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:16.689005 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8e5697fa6741a2bbaac62dd0175a50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:16.698425 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8e5697fa6741a2bbaac62dd0175a50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:16.699097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8e5697fa6741a2bbaac62dd0175a50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:16.716439 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1409/2845] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:06:16 2022] DELETE /identity/v3/users/9f8e5697fa6741a2bbaac62dd0175a50 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:16.721060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:16.721531 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:16.721680 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:16.739906 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:16.741111 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:16.803058 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1437/2846] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:16.813108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:16.814636 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:16.874160 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b500d-7ab6-4aca-98d4-ac838f0450cd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:16.877922 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:16.878611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:16.878894 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:16.879199 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:16.889770 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:16.891251 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:16.901065 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1410/2847] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:17.185907 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:17.187482 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:17.200764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd036f34-7f2d-4a40-bb4d-c448ef738ce9 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:17.207361 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:17.208255 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:17.208542 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:17.208821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] PATH_INFO: `/v3/projects/eb610d4085e44e789a8db5ed2b399621` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:17.210917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb610d4085e44e789a8db5ed2b399621)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:17.212879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:17.265323 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb610d4085e44e789a8db5ed2b399621', 'request_id': 'req-a11c13d5-6af6-4505-99e2-879d5092957c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.275056 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb610d4085e44e789a8db5ed2b399621', 'request_id': 'req-a11c13d5-6af6-4505-99e2-879d5092957c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.282277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb610d4085e44e789a8db5ed2b399621', 'request_id': 'req-a11c13d5-6af6-4505-99e2-879d5092957c'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.293628 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] The token cache is being invalidate because project eb610d4085e44e789a8db5ed2b399621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:06:17.293874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.294504 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.296065 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1438/2848] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:06:17 2022] DELETE /identity/v3/projects/eb610d4085e44e789a8db5ed2b399621 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:17.300322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:17.309984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4b020-4665-4eaf-ad9a-e20a7690330d service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:17.333550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:17.373926 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:17.374820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:17.375108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:17.375389 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] PATH_INFO: `/v3/users/d78396450492483d88a54be7dba31a22` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:17.376654 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78396450492483d88a54be7dba31a22)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:17.378680 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:17.429577 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78396450492483d88a54be7dba31a22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.437374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78396450492483d88a54be7dba31a22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.438154 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78396450492483d88a54be7dba31a22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.446589 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78396450492483d88a54be7dba31a22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.447319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4b507e3f-5896-4265-9b88-14f958a6e894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78396450492483d88a54be7dba31a22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.467043 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1411/2849] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:06:17 2022] DELETE /identity/v3/users/d78396450492483d88a54be7dba31a22 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:17.767294 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:17.768863 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:17.783604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c13d5-6af6-4505-99e2-879d5092957c admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:17.846745 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:17.847540 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:17.847845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:17.848126 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] PATH_INFO: `/v3/projects/e1385dd4b91c4f4f882b8759cce3dc5f` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:17.849315 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1385dd4b91c4f4f882b8759cce3dc5f)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:17.851274 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:17.885870 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:17.905565 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1385dd4b91c4f4f882b8759cce3dc5f', 'request_id': 'req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.914621 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1385dd4b91c4f4f882b8759cce3dc5f', 'request_id': 'req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.922127 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1385dd4b91c4f4f882b8759cce3dc5f', 'request_id': 'req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.934742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] The token cache is being invalidate because project e1385dd4b91c4f4f882b8759cce3dc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:06:17.935044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.935720 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:17.941358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1439/2850] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:06:17 2022] DELETE /identity/v3/projects/e1385dd4b91c4f4f882b8759cce3dc5f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:17.943117 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac10a-ecb2-4f96-9fe1-412c227f1ca9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:17.943566 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac10a-ecb2-4f96-9fe1-412c227f1ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:17.943823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac10a-ecb2-4f96-9fe1-412c227f1ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:17.963873 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-974ac10a-ecb2-4f96-9fe1-412c227f1ca9 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:17.965252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-974ac10a-ecb2-4f96-9fe1-412c227f1ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:18.004553 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.006549 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:18.027349 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1412/2851] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:18.035373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.035693 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.036245 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.057179 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:18.058498 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:18.070638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1413/2852] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 12:06:18.070834 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43e8a5-e785-490e-aa83-dd1a6eda52d3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.071713 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.074587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.075252 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.075541 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.075821 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.078025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:18.081547 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af746ff-4040-48c5-a2a9-97f4cdcaa0a5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.086849 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.087586 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.087937 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.088295 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.089032 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:06:18.089395 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.091057 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.104335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1414/2853] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:06:18.109081 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.119413 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89eaa-44a0-407c-82dd-f59a94ba9b4e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.124671 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.125448 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.125855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.126205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.126988 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.128993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.152197 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:18.162223 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1415/2854] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:06:18 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:06:18.166165 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.166359 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.167899 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.180339 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1440/2855] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:18.234823 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1482aca-c9d8-4096-870f-787a096a69c9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.240374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.241053 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.241310 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.241582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.242307 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.244264 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.269421 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1416/2856] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:06:18 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:18.273669 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.284214 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2148eae-f4b2-4ab1-a66b-a600c6f38d6a service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.288933 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.289703 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.290053 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.290424 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.291234 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.292953 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.303203 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1441/2857] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:06:18.307708 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.318523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc1bd6-e1c1-49f0-967d-541ef8879d80 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.323092 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfea3f-4eea-4064-9cb3-8661f4237bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.323796 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfea3f-4eea-4064-9cb3-8661f4237bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.324080 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfea3f-4eea-4064-9cb3-8661f4237bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.324354 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfea3f-4eea-4064-9cb3-8661f4237bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.325086 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfea3f-4eea-4064-9cb3-8661f4237bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.326742 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfea3f-4eea-4064-9cb3-8661f4237bf1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.336824 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1417/2858] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:18.341297 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.352519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1960e-1efd-40e3-afd3-754f046d5772 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.359011 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.359850 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.360136 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.360416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] PATH_INFO: `/v3/projects/134c176fb62d41b1b72679d0324868f6/users/1afbebbbfe29408b943df1d86e3bf8ef/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.377353 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134c176fb62d41b1b72679d0324868f6, user_id=1afbebbbfe29408b943df1d86e3bf8ef, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.381511 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.399340 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1442/2859] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:18 2022] PUT /identity/v3/projects/134c176fb62d41b1b72679d0324868f6/users/1afbebbbfe29408b943df1d86e3bf8ef/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:18.463509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.463875 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.464218 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.492532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] MFA Rules not processed for user `1afbebbbfe29408b943df1d86e3bf8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:18.493774 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:18.563458 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1418/2860] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:18.568642 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.593239 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:18.639081 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65638ba9-6b16-4488-9dc8-90de71cce553 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.644351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.645015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.645286 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.645563 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.646256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.648196 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.676695 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1443/2861] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:06:18 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:18.680911 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.692611 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98136-42ea-42f1-844d-d238705a9269 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.754832 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720887df-9065-4875-b074-0191886b439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.755509 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720887df-9065-4875-b074-0191886b439f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.755797 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720887df-9065-4875-b074-0191886b439f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.756076 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720887df-9065-4875-b074-0191886b439f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.756771 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720887df-9065-4875-b074-0191886b439f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.758751 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720887df-9065-4875-b074-0191886b439f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.776438 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:18.783646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1419/2862] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:06:18 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:18.787439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.798762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52bad6-1902-40b0-ad1d-4c075b3dfccf admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.804170 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.804845 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.805148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.805421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.806212 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.807935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.819423 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1444/2863] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:06:18.824008 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720887df-9065-4875-b074-0191886b439f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.835315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720887df-9065-4875-b074-0191886b439f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.841918 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.842818 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.843108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.843386 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] PATH_INFO: `/v3/projects/b97c8d970708488b8778e3fd514e02b2/users/408305b5d0b44fb497a9031baaaab34d/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.861385 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97c8d970708488b8778e3fd514e02b2, user_id=408305b5d0b44fb497a9031baaaab34d, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.864149 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.879691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1420/2864] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:18 2022] PUT /identity/v3/projects/b97c8d970708488b8778e3fd514e02b2/users/408305b5d0b44fb497a9031baaaab34d/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:18.883755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.894033 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50180b4e-735d-4237-bb8d-802399c79f92 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.955591 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933e296-3202-4a7d-840e-6921bc85c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.956322 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e296-3202-4a7d-840e-6921bc85c728 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.956604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e296-3202-4a7d-840e-6921bc85c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.956878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933e296-3202-4a7d-840e-6921bc85c728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.957624 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933e296-3202-4a7d-840e-6921bc85c728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.959256 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933e296-3202-4a7d-840e-6921bc85c728 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:18.969935 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1445/2865] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:18.974337 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:18.985454 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfdcfb-831b-4c3b-a415-4eef90a5e844 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:18.990735 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:18.991657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:18.991942 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:18.992216 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] PATH_INFO: `/v3/projects/b97c8d970708488b8778e3fd514e02b2/users/408305b5d0b44fb497a9031baaaab34d/roles/2702c53281284456a65007036b36070c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:18.994284 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97c8d970708488b8778e3fd514e02b2, user_id=408305b5d0b44fb497a9031baaaab34d, role_id=2702c53281284456a65007036b36070c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:18.997657 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:19.008136 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1421/2866] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:18 2022] PUT /identity/v3/projects/b97c8d970708488b8778e3fd514e02b2/users/408305b5d0b44fb497a9031baaaab34d/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:19.018393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:19.018686 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:19.018970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:19.047645 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] MFA Rules not processed for user `408305b5d0b44fb497a9031baaaab34d`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:19.048858 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:19.118917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1446/2867] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:19.130859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:19.133864 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:19.193780 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5f915-c20e-4b6c-b6c0-e8467d3f3cb8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:19.197897 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:19.198646 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:19.198931 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:19.199194 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:19.211543 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:19.213789 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:19.229480 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1422/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:19.274662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:19.276176 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:19.289650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1417c-ea63-4312-9906-a4978d7a7fb5 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:19.294519 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:19.295174 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:19.295460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:19.295735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:19.309421 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:19.363678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:19.365462 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:19.376110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1447/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:19.384132 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:19.443097 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8459c1-893c-40d2-806f-31719921e251 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:19.446750 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:19.447535 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:19.447845 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:19.448101 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:19.450165 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:19.532373 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:19.534550 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28419bb9-5d1d-46e7-918a-3f3fa0936f1d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:19.549228 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1423/2870] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 12:06:22.773207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:22.838439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40f418-c086-4202-b1c8-cfa0b71a0b1e service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:22.844045 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:22.844934 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:22.845217 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:22.845492 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] PATH_INFO: `/v3/users/1afbebbbfe29408b943df1d86e3bf8ef` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:22.846739 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afbebbbfe29408b943df1d86e3bf8ef)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:22.848656 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:22.899644 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afbebbbfe29408b943df1d86e3bf8ef'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:22.908481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afbebbbfe29408b943df1d86e3bf8ef'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:22.915764 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afbebbbfe29408b943df1d86e3bf8ef'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:22.916448 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afbebbbfe29408b943df1d86e3bf8ef'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:22.929839 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afbebbbfe29408b943df1d86e3bf8ef'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:22.936025 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1448/2871] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:06:22 2022] DELETE /identity/v3/users/1afbebbbfe29408b943df1d86e3bf8ef => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:22.940740 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:22.941252 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:22.941512 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:22.948867 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:22.962233 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:22.963422 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:23.026645 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1424/2872] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:23.036678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:23.038207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:23.080579 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:23.106481 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b891-6554-4bfc-95b7-7c221408d47a admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:23.110140 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:23.110830 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:23.111114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:23.111392 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:23.123770 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:23.125241 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:23.136966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1449/2873] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:23.471883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:23.473493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:23.497862 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84e74-f602-4146-9414-2834bdfc82d5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:23.503513 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:23.504609 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:23.505016 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:23.505356 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] PATH_INFO: `/v3/projects/134c176fb62d41b1b72679d0324868f6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:23.506785 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=134c176fb62d41b1b72679d0324868f6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:23.508836 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:23.570575 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134c176fb62d41b1b72679d0324868f6', 'request_id': 'req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.583246 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134c176fb62d41b1b72679d0324868f6', 'request_id': 'req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.591732 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134c176fb62d41b1b72679d0324868f6', 'request_id': 'req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.610250 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] The token cache is being invalidate because project 134c176fb62d41b1b72679d0324868f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:06:23.611479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.611855 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.617285 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1425/2874] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:06:23 2022] DELETE /identity/v3/projects/134c176fb62d41b1b72679d0324868f6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:23.618587 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:23.633915 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7be95-bf74-4c45-80de-675a83e9210b service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:23.698596 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:23.699808 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:23.700098 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:23.700377 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] PATH_INFO: `/v3/users/408305b5d0b44fb497a9031baaaab34d` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:23.701647 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408305b5d0b44fb497a9031baaaab34d)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:23.703578 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:23.752705 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408305b5d0b44fb497a9031baaaab34d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.761267 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408305b5d0b44fb497a9031baaaab34d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.768887 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408305b5d0b44fb497a9031baaaab34d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.769661 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408305b5d0b44fb497a9031baaaab34d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.781622 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e0db8b1c-a4a7-444c-a686-7bef268e5e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408305b5d0b44fb497a9031baaaab34d'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:23.787874 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1450/2875] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:06:23 2022] DELETE /identity/v3/users/408305b5d0b44fb497a9031baaaab34d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:24.154917 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.156482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:24.170678 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1aac2-a71a-4593-91d1-f06e278a7f7e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.227806 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.228679 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.229292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.229570 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] PATH_INFO: `/v3/projects/b97c8d970708488b8778e3fd514e02b2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.231335 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97c8d970708488b8778e3fd514e02b2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.233292 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.274383 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:24.289485 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97c8d970708488b8778e3fd514e02b2', 'request_id': 'req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:24.298728 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97c8d970708488b8778e3fd514e02b2', 'request_id': 'req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:24.305198 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97c8d970708488b8778e3fd514e02b2', 'request_id': 'req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:24.316302 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] The token cache is being invalidate because project b97c8d970708488b8778e3fd514e02b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:06:24.316525 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:24.317262 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eed4517f-73a7-4b3b-8d75-5a15b898aa6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:24.319078 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1426/2876] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:06:24 2022] DELETE /identity/v3/projects/b97c8d970708488b8778e3fd514e02b2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:24.324455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.324751 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.325034 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.344685 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:24.345939 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:24.397968 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:24.411878 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1451/2877] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:24.419582 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.419871 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.420176 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.439939 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:24.441148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:24.449803 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1427/2878] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:24.453966 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.464180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd378d-3e72-4a60-9f3d-1ba2c21f99b8 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.469332 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.470079 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.470362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.470641 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.471362 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:06:24.471671 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.473295 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.489430 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1452/2879] 10.222.0.27 () {58 vars in 1152 bytes} [Thu Jun 23 12:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:06:24.491205 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.501147 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2696d2-42d0-4a06-8d20-7ee971843b48 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.505893 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.506548 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.506827 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.507099 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.507799 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.509725 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.538301 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1428/2880] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:06:24 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:24.543432 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.554183 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee20e5e-d562-4b94-86b4-a9a10a15c4a5 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.621015 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.622254 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.622650 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.623044 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.624080 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.626996 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.660717 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1453/2881] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:06:24 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:24.661968 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.672878 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59300045-da3f-45bd-9f4f-b7e16071e0fb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.677459 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.678152 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.678433 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.678703 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.679437 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.681024 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.691744 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1429/2882] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:06:24.695817 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.706731 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893e74-b010-42d1-ae08-09c45b2982e3 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.711524 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb945fd-1cf3-4309-bd40-cbacd2b3019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.712175 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb945fd-1cf3-4309-bd40-cbacd2b3019a admin admin] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.712455 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb945fd-1cf3-4309-bd40-cbacd2b3019a admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.712729 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb945fd-1cf3-4309-bd40-cbacd2b3019a admin admin] PATH_INFO: `/v3/roles` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.713460 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb945fd-1cf3-4309-bd40-cbacd2b3019a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.715122 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb945fd-1cf3-4309-bd40-cbacd2b3019a admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.726539 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1454/2883] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:24.731523 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.742537 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472933-61db-4b8c-a628-5b2aba388342 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.748993 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.749929 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.750214 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.750491 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] PATH_INFO: `/v3/projects/e1486332394c4f80bc9badd1c4b7d779/users/c18097bbb6ae4ad5bbd4afd53d80a244/roles/74a02bd410af491aba0207712ba4d774` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.766487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1486332394c4f80bc9badd1c4b7d779, user_id=c18097bbb6ae4ad5bbd4afd53d80a244, role_id=74a02bd410af491aba0207712ba4d774)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.769315 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:24.787549 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1430/2884] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:24 2022] PUT /identity/v3/projects/e1486332394c4f80bc9badd1c4b7d779/users/c18097bbb6ae4ad5bbd4afd53d80a244/roles/74a02bd410af491aba0207712ba4d774 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:06:24.804835 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.805347 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.805444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.836213 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.auth.core [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] MFA Rules not processed for user `c18097bbb6ae4ad5bbd4afd53d80a244`. Rule list: `[]` (Enabled: `True`). {{(pid=80159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:24.837376 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:24.904049 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1455/2885] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:24.908829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:24.973330 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a5ecd-de14-4e32-b284-d3288630ea4d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:24.978112 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:24.978787 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:24.979070 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:24.979351 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:24.980085 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:24.982404 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.010374 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1431/2886] 10.222.0.27 () {60 vars in 1152 bytes} [Thu Jun 23 12:06:24 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:25.014358 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:25.026206 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca19cc-2b71-4a16-a0db-9ebba4272a53 None None] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:25.076357 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:25.088380 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:25.089135 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] REQUEST_METHOD: `POST` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.089626 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.090082 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] PATH_INFO: `/v3/users` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.090791 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:25.092743 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.113728 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1456/2887] 10.222.0.27 () {60 vars in 1143 bytes} [Thu Jun 23 12:06:25 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:06:25.117891 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:25.128681 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf55c-4a84-4cb2-b477-20c5c9359c7e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:25.133883 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:25.134554 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.134840 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.135118 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.135963 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:25.137640 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.148604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1432/2888] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:25.152742 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:25.163469 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c874-1059-4f4e-a7de-fb598d753816 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:25.169678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:25.170779 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.170991 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.171251 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] PATH_INFO: `/v3/projects/cdce93ec5fc9462f95cd2cc33e87cdf5/users/ca32944c9d5d470496584711ffa83863/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.186793 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdce93ec5fc9462f95cd2cc33e87cdf5, user_id=ca32944c9d5d470496584711ffa83863, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:25.189498 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.204464 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1457/2889] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:25 2022] PUT /identity/v3/projects/cdce93ec5fc9462f95cd2cc33e87cdf5/users/ca32944c9d5d470496584711ffa83863/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:06:25.208514 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:25.219494 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa526f2-b8e2-4600-9913-4e4434459495 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:25.247505 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:25.281103 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832a33-983b-48ab-a5ad-01ae75c908a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:25.281829 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832a33-983b-48ab-a5ad-01ae75c908a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.282141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832a33-983b-48ab-a5ad-01ae75c908a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.282416 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832a33-983b-48ab-a5ad-01ae75c908a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.283148 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832a33-983b-48ab-a5ad-01ae75c908a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:25.284755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832a33-983b-48ab-a5ad-01ae75c908a8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.295370 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1433/2890] 10.222.0.27 () {58 vars in 1121 bytes} [Thu Jun 23 12:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:06:25.300207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:25.316762 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ecb64-29cf-4c93-80a3-75df462cc4a0 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:25.324749 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:25.325639 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.325970 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.326240 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] PATH_INFO: `/v3/projects/cdce93ec5fc9462f95cd2cc33e87cdf5/users/ca32944c9d5d470496584711ffa83863/roles/2702c53281284456a65007036b36070c` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.328501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdce93ec5fc9462f95cd2cc33e87cdf5, user_id=ca32944c9d5d470496584711ffa83863, role_id=2702c53281284456a65007036b36070c)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:25.331195 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.342076 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1458/2891] 10.222.0.27 () {60 vars in 1482 bytes} [Thu Jun 23 12:06:25 2022] PUT /identity/v3/projects/cdce93ec5fc9462f95cd2cc33e87cdf5/users/ca32944c9d5d470496584711ffa83863/roles/2702c53281284456a65007036b36070c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:06:25.352540 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.352831 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.353093 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.382277 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] MFA Rules not processed for user `ca32944c9d5d470496584711ffa83863`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:25.383552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:25.457279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1434/2892] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:25.469551 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:25.471692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:25.538035 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de23fb-7fb2-4243-a91f-de5ff54aea9e admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:25.541902 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:25.542792 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:25.543101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:25.543999 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:25.606841 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:25.609155 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:25.620020 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1459/2893] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:27.007360 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:27.009568 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:27.029958 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b14ad-1f65-4a29-929f-46bbffc21c25 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:27.034890 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684108fd-c7b8-4b27-91ab-cca92949c5a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ae4c65d3be47eeb52566dec6cb286c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:27.035717 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684108fd-c7b8-4b27-91ab-cca92949c5a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:27.036279 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684108fd-c7b8-4b27-91ab-cca92949c5a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:27.036532 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684108fd-c7b8-4b27-91ab-cca92949c5a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:27.048125 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684108fd-c7b8-4b27-91ab-cca92949c5a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:27.049571 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684108fd-c7b8-4b27-91ab-cca92949c5a3 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:27.059812 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1435/2894] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:30.879018 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:30.940425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:30.945075 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe7e40-ec6b-4e1b-898a-222ebfd746de service cinder] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:30.952110 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:30.953163 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:30.953456 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:30.953796 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] PATH_INFO: `/v3/users/c18097bbb6ae4ad5bbd4afd53d80a244` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:30.955085 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18097bbb6ae4ad5bbd4afd53d80a244)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:30.957167 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:31.009820 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18097bbb6ae4ad5bbd4afd53d80a244'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.018879 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18097bbb6ae4ad5bbd4afd53d80a244'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.026097 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18097bbb6ae4ad5bbd4afd53d80a244'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.026747 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18097bbb6ae4ad5bbd4afd53d80a244'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.038905 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18097bbb6ae4ad5bbd4afd53d80a244'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.045120 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1460/2895] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:06:30 2022] DELETE /identity/v3/users/c18097bbb6ae4ad5bbd4afd53d80a244 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:31.049859 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:31.050366 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:31.050477 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:31.068166 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] MFA Rules not processed for user `81d8701e76e24867a0ae6f975b85ab36`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:06:31.069375 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:31.134484 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1436/2896] 10.222.0.27 () {58 vars in 957 bytes} [Thu Jun 23 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 12:06:31.144662 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:31.146379 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:31.206501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98bbc-d0dd-4fd1-872e-8294567cfb50 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:31.212812 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:31.213735 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:31.214073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:31.214444 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:31.229302 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:31.232095 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:31.242677 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1461/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:06:31.539604 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:31.541357 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:31.554781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad6bc1-3078-4bf9-8d91-0086f1c0407b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:31.559529 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:31.565173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:31.565173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:31.565173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] PATH_INFO: `/v3/projects/e1486332394c4f80bc9badd1c4b7d779` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:31.565173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1486332394c4f80bc9badd1c4b7d779)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:31.565173 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:31.605487 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:31.620773 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1486332394c4f80bc9badd1c4b7d779', 'request_id': 'req-0979aaa2-37d8-4436-aa62-64f8b8802e87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.629876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1486332394c4f80bc9badd1c4b7d779', 'request_id': 'req-0979aaa2-37d8-4436-aa62-64f8b8802e87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.636336 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1486332394c4f80bc9badd1c4b7d779', 'request_id': 'req-0979aaa2-37d8-4436-aa62-64f8b8802e87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.647108 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] The token cache is being invalidate because project e1486332394c4f80bc9badd1c4b7d779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:06:31.647400 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.648141 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.649876 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1437/2898] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:06:31 2022] DELETE /identity/v3/projects/e1486332394c4f80bc9badd1c4b7d779 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:31.654118 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:31.664180 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea89f58-6b1c-4997-978f-6007c0c01fdb service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:31.726977 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:31.727860 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:31.728148 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:31.728425 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] PATH_INFO: `/v3/users/ca32944c9d5d470496584711ffa83863` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:31.729692 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca32944c9d5d470496584711ffa83863)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:31.731976 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:31.753457 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:31.783855 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca32944c9d5d470496584711ffa83863'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.795263 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca32944c9d5d470496584711ffa83863'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.805794 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca32944c9d5d470496584711ffa83863'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.806723 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca32944c9d5d470496584711ffa83863'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.820028 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca32944c9d5d470496584711ffa83863'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:31.826501 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1462/2899] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:06:31 2022] DELETE /identity/v3/users/ca32944c9d5d470496584711ffa83863 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:06:32.118131 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:06:32.119661 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:06:32.134226 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979aaa2-37d8-4436-aa62-64f8b8802e87 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:06:32.198986 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:06:32.199755 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:06:32.200042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:06:32.200322 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] PATH_INFO: `/v3/projects/cdce93ec5fc9462f95cd2cc33e87cdf5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:06:32.201632 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdce93ec5fc9462f95cd2cc33e87cdf5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:06:32.205066 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:06:32.255619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdce93ec5fc9462f95cd2cc33e87cdf5', 'request_id': 'req-378cb774-d384-4150-a268-481b22f03b85'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:32.264857 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdce93ec5fc9462f95cd2cc33e87cdf5', 'request_id': 'req-378cb774-d384-4150-a268-481b22f03b85'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:32.271691 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdce93ec5fc9462f95cd2cc33e87cdf5', 'request_id': 'req-378cb774-d384-4150-a268-481b22f03b85'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:32.283261 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] The token cache is being invalidate because project cdce93ec5fc9462f95cd2cc33e87cdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:06:32.283552 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:32.284256 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:06:32.285956 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1438/2900] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:06:32 2022] DELETE /identity/v3/projects/cdce93ec5fc9462f95cd2cc33e87cdf5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:06:41.822807 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:06:42.279733 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:22.726548 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:22.728331 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:22.795944 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cffe08-1739-4b35-b75d-6a7e981a1c96 admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:22.847755 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3808efbe570448c8780ed114d0379e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:22.848422 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:22.848696 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:22.848955 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:22.851067 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:22.861009 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:22.862403 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:22.870454 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1463/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:07:32.867187 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=46 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:37.460738 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:37.462879 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:37.559135 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb774-d384-4150-a268-481b22f03b85 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:37.565619 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d5dafc333e54d20aebe2929e1f8a4d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:37.566479 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:37.566895 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:37.567303 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:37.569502 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:37.590792 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:37.592572 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:37.607088 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1439/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:07:46.769210 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:46.771472 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:46.860105 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:46.863192 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:46.864682 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273a0f7-250e-4229-a03c-81a8bb2fa336 service neutron] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:46.870121 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:46.870788 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] REQUEST_METHOD: `GET` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:46.871073 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:46.871351 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:46.873207 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:46.887404 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:46.889510 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:46.901060 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1464/2903] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:07:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:07:46.947317 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdf47c-7153-4891-b00a-b6d2713d4a93 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:46.953381 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:46.954583 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:46.954868 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:46.955390 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] PATH_INFO: `/v3/users/0f49a07d8fc94ea8a7dc54a2ec8654ce` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:46.956634 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f49a07d8fc94ea8a7dc54a2ec8654ce)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:46.958623 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:47.017902 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f49a07d8fc94ea8a7dc54a2ec8654ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.025306 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f49a07d8fc94ea8a7dc54a2ec8654ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.026042 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f49a07d8fc94ea8a7dc54a2ec8654ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.036015 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f49a07d8fc94ea8a7dc54a2ec8654ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.036699 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f49a07d8fc94ea8a7dc54a2ec8654ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.056234 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1440/2904] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:07:46 2022] DELETE /identity/v3/users/0f49a07d8fc94ea8a7dc54a2ec8654ce => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:07:47.252101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:47.264867 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137faf32-f863-438b-8b6f-f49b72b0e3b3 service placement] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:47.332634 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:47.334595 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:47.335393 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:47.336101 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] PATH_INFO: `/v3/projects/0e4c27c608a54af0b4796105ab88a785` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:47.339303 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4c27c608a54af0b4796105ab88a785)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:47.342409 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:47.396909 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4c27c608a54af0b4796105ab88a785', 'request_id': 'req-e6e02fdc-e166-4e16-9061-db428eb637ca'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.406158 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4c27c608a54af0b4796105ab88a785', 'request_id': 'req-e6e02fdc-e166-4e16-9061-db428eb637ca'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.412673 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4c27c608a54af0b4796105ab88a785', 'request_id': 'req-e6e02fdc-e166-4e16-9061-db428eb637ca'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.425277 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] The token cache is being invalidate because project 0e4c27c608a54af0b4796105ab88a785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:07:47.425566 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.426381 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.428071 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1465/2905] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:07:47 2022] DELETE /identity/v3/projects/0e4c27c608a54af0b4796105ab88a785 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:07:47.432656 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:47.434240 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:47.448493 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:47.454945 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac180fc-53b7-4c00-9b5e-8123146ac395 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:47.522162 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:47.523051 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:47.523338 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:47.523618 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] PATH_INFO: `/v3/users/4d65ca7c87f04fb480ff8eabc0d6e057` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:47.524948 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d65ca7c87f04fb480ff8eabc0d6e057)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:47.526949 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:47.589782 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d65ca7c87f04fb480ff8eabc0d6e057'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.597238 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d65ca7c87f04fb480ff8eabc0d6e057'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.597984 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d65ca7c87f04fb480ff8eabc0d6e057'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.608146 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d65ca7c87f04fb480ff8eabc0d6e057'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.608959 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d65ca7c87f04fb480ff8eabc0d6e057'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.627530 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1441/2906] 10.222.0.27 () {58 vars in 1223 bytes} [Thu Jun 23 12:07:47 2022] DELETE /identity/v3/users/4d65ca7c87f04fb480ff8eabc0d6e057 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:07:47.810737 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Authenticating user token {{(pid=80159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:07:47.812416 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.fernet_utils [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:07:47.826678 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02fdc-e166-4e16-9061-db428eb637ca admin admin] Validating token access rules against request {{(pid=80159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:07:47.849168 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:47.894291 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81d8701e76e24867a0ae6f975b85ab36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d05c319491241dd84abdf976390ca06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:07:47.895275 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:07:47.895604 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:07:47.895889 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] PATH_INFO: `/v3/projects/da49600a4c514c1e94692c2695ee510b` {{(pid=80159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:07:47.897137 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=da49600a4c514c1e94692c2695ee510b)` {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:07:47.899114 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] RBAC: Authorization granted {{(pid=80159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:07:47.944917 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da49600a4c514c1e94692c2695ee510b', 'request_id': 'req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.954893 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da49600a4c514c1e94692c2695ee510b', 'request_id': 'req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.964192 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da49600a4c514c1e94692c2695ee510b', 'request_id': 'req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb'} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.976150 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] The token cache is being invalidate because project da49600a4c514c1e94692c2695ee510b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 12:07:47.976439 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.977157 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG keystone.notifications [None req-60caf521-0cc4-4cef-b66e-9c3c6b01c1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 12:07:47.978844 dv-cinder-826608-3-smb devstack@keystone.service[80159]: [pid: 80159|app: 0|req: 1466/2907] 10.222.0.27 () {58 vars in 1232 bytes} [Thu Jun 23 12:07:47 2022] DELETE /identity/v3/projects/da49600a4c514c1e94692c2695ee510b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:07:57.623940 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:57.972816 dv-cinder-826608-3-smb devstack@keystone.service[80159]: DEBUG dbcounter [-] [80159] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:30.941320 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:09:30.943638 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:09:31.111069 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80c475-78e5-4e1f-b8c6-8242bf08e687 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:09:31.171820 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12a98501cfe942dda4c2c8350215bcea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc7763b1475407d9bf9d9bfa6a03701', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:09:31.172482 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:09:31.172769 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:09:31.173049 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:09:31.174976 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:09:31.186781 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:09:31.188319 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a19c3-4eb8-4a26-b5d3-1c2d02103fe3 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:09:31.198242 dv-cinder-826608-3-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1442/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Jun 23 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 12:09:41.194328 dv-cinder-826608-3-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}